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The majority of the proceedings of the workshop held in 
Cc^cil Bluffs, Iowa, March 26th and 27th were compiled and edited 
for this publication. Scripts from films and slide-tape presentations 
were not included. Information on the Wide Range Achievement Test, 
APEX, and Talent Assessment Programs was added to supplement the 
information provided dyring the workshop. 

This material was compiled and printed to provide educators 
and other professional personnel information^atf^reer assessment 
systems. However, it should be recognized that the descriptive 
information that has been included may change periodically 
since revisions are being made to improve the systems. The 
ir.tor.rar.ion in this publication was accurate as of March 22th, 
1973. Up-to-date information should be requested from the 
distributors. 
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Assessment Systems 
in 

Career Development Programs 
Jim Athen 

Assistant Director, Career Education 
Iowa Department of Public Instruction 

Presented at the Iowa Invitational Workshop 
on Assessment Systems and Career Development Programs 

f Council Bluffs, Icwa 

March 26-27, 1973 

When the Special Needs Section staff approactied me or. the possibility of 
my meeting with you this evening, f.hey Indicated several' areas that might 
be appropriate. A few of those areas were: 

(1) What is the outlook for assessment programs? « 

(2) How mucii attention has been given to assessment in Vocational 
Education? 

(3) Where do assessment programs fit into the funding structure? 

(4) Who is to give leadership and direcrion to assessment efforts? 

These appear to be very appropriate and pertinent points to raise. Before 
we move into comments on each, let's digress just a bit and see if we are all 
on tha same wave length regarding this subject at hand. 

This conference is centered aroand the subject of "Vocational Assessment*" 
Are we together on purpose? What are we after? What do vre wish to accomplish 
as a result of being here? How do our efforts relate to, or complement the 
direction being e tablished for the implementation of career education? 
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When we use the term '^Vocational Assessment" are we using vocational as 
3 diescriptcr of an assessment process with the intent to limit assessment to 
a specific area (rnanual dexterity) or skills of an individual? Early efforts 
(the movement began in the early 1900's) promoted the search for one's true 
vocation. This focus on individuality was complimented by respect for the 
occupational mutti-potentialit> of each individual. The reshaping of our 

occupational structure during the past few years, however, has greatly 

J 

eroded the meaning of spiritual calling in the term vocation. A modern 
secular ver^slon is found currently in the American obsession of self- 
fulfillment. How compatible is this to the philosophy of vocational education 
manpower, and realities of life? 

We now wonder whether it is possible for all our labor force to find 

in work a sense of vocation or an avenue to self- fulfillment. /Some ^s^uggest 

I 

that the alternatives of work either as vocation, as occupation^ or^as a 
kind of undifferentiated employment may be deliberately chosen by an 
individual as part of his career development. A semantic distinction of 
interest here concerns the meaning of vocation in Vocat^-onal Assessment. 
The social reformers who generated vocational education movement probably 
shared the ..eueenth century view of vocation as a calling and as a means 
of self- fulfillment. But vocation in vocational education and in the 
meaning of vocational assessment has been more narrowly identified in terms 
of trades. The Smith-Hughes Act officially confirmed this craft orientation. 
Recent changes in manpower policy, particularly the Vocational /^pt of 1963, 
have tended to loosen the definition to include the wide range of occupations 
requiring various degrees of competencies. 



Some Individuals Involved with estabtlishing and implementing these 
educational efforts, however, are likely to continue to define vocation 
in terms of the standards and qualifications of specific occupations. 
Many teachers, administrators and support personnel are not seriously trying 
to reconceptualize the mission and content of the educational programs, * 
services and activities for which they are responsible. They have tended 
in recent years to orient their efforts more broadly to the notion of career 
and to orient services to career development. 

Let* 8 look at the outlook for assessment programs* 1 believe it goes 
without much dlsagreemeiit that if we are to more effectively meet the 
career development needs of a greater number of individuals, we oiust eomehbw 

provide the resources (expertise, monies, setting) and commitment to assess 

/ 

these needs. We have too frequently implemented educational programs in 
response to guidelines conceived in federal agencies whiph may not be 
appropriate for a' specific setting. The challenge is great to educational 
administrators, directors, coordinators, cou|iselors, and instructional personnel 
to find more effective ways and more appropriate approaches to facilitate 
a more productive assessment effort. How can the career development needs of 
individuals be met. if assistance in assessing one's interests, attitudes, \ 
and competencies is not available? The question seems not to be one of 
whether assessment should be^ viewed as an integral part of the continuous 
educational process or a specific center approach (three weeks of concentrated 
assessment experience at the 10th grade), but one of assessment assistance 
to be assured. 
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\ Outlook In terms of need for sound assessment efforts is great. The 

cotmnitment by all educational agencies appears to be growing. Ihe uncertainty 
of categprical funding previously available to stimulate development and 
support assessment efforts necessitates us all to look to other sources of 
support. This search will test the commitment to these types of services. 
Ihe efforts such as those in Pottawattamie County and odier areas will serve 
as very valuable benchmarks and examp7.es of why, how» and tor whom such 
services be provided, \ ^ 

I believe we may all agree to a statement that "not enou^'* vpcational 
assessment has occurred in vocational education, However, efforts to 
assess and/or evaluate students have increased. The n^ds of an individual 
within a specific program population has be^n a growing concern probably 
because of the great deal of stimulation provided by federal legislation with 
Increased emphasis on accountability. 
J Some of the best efforf In vocational/career assessment have come from 
the multi^discipline approaches supported through the leadership of the 
Special Needs S#?ction and the Guidance Servicejs Section of the Department of 
Public Instruction. These activities have been administered by the area 
schools (Iov^ area Community Colleges or vocational- technical schools) 
either as a part of the student services division or as a special center 
within the institution's administrative structure. The foll^ing institutions 
have been identified as making considerable contribution in this regard: 
Indian Hills Community College, Otturawa; Kirkwood Community College^ Cedar 
Rapids; Hawkeye Tech Institute, Waterloo; and Des Moines Area Coomunity 
College, Des ^k>ine.'. The project here in Pottawattamie County and Project 
Discovery at Red Oak, Iowa, have also been identified as contributing sub- 
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stantlally to the efforts being made in vocational educaMon on an organized 
special project basis. 

Vocational assessmen.M^es' fit into the funding structure. To be quite 
<^M4id, i( appears that if educational agencies hold a coanitment to provide 
quality education that meets the needs of t\yet youth and adults, it must accept 
the responsibility for vocational/career assessment/ They appear inseparable. 
The support in resources to assure service or assistance in assessoienf of need 
and provision of relevant educatioi«al experiences is built into the base 
support of the institution. The challc nge appears to be to obtain the 
appropriate coranitment or resources (expertise, funds, setting) to assure 0. 
that local millage and general aid serv^ as base support in this regard. 
Categorical state and federal dollars haye served and Indications are that some 
funds should be available, in fiscal year 1974, to provide support for 
exemplary, pilot and demons trat ion activi^es. Relatively small portions of 
the monies have gone toward maintaining assessment efforts as an ongoing 
function of an Institution. These exemp^ry, pilot and demonstration efforts 
have becfn administered through the following units within the Iowa Department 
of Public Instruction: Special Needs Section; Special Education Division; 
Rehabilitation Education \and Services Branch; Guidance Services Section; 
and Career Education Division. 

Leadership and direction should be given to the assessment effort. The 
best response can only come from those who understand and who are committed to 
the effort, and who manage resources. Administrative responses may -become 
philosophically laden with platitudes, subject to much review and may fade 
Into oblivion due to a lack of concensus operationally. The responsibility 
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for leadership and direction may already be fixed In the structure you are 
nov attached. The question way more appropriately be, "Are we all aware 



of 'who^and 'what* Is being dene to Influence the lmple<aentation 
the service of assessment?". We In the State educational a^ncy are cnaaictod 
and we will continue to strive to provide leadership and help to provide 
quality career assessment services for all youth and adults in Iowa* With 
your cofwnltment and Support, we look forward to moving ahead in Cls very 
essential component of the educational process* 



' Jim A then 
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VOCATTOm ASSESSMENT: WHAT CAN BE CMNED FROM IT? 

Donn Brolin 
University of Missouri - Columbia 

Paper Presented at the Iowa Invitatirnal Workshop 
On Assessment Systems and Career Envelopment Programs 

Council Bluffs, Iowa 
March 26-27 1973 



I am very pleased to again have the opportunity to return to Iowa and 
*$peak on the subject of vocational evaluation. As most of you knew, Dur 
current systems of delivery of services to the various types of handicapped 
persons have really come under considerable fire. At a recent conference 
on career education for the handicapped in New Orleans, Dr. Edward Martin, 
Associate Commissioner, Bureau for the Education of the Handicapped, re- 
ported that still only one-half of the children needing special education 
are actually getting it. He indicated further that we have not developed 
appropriate education at the junior and senior high school levels for our 
handicapped children. At that same conference, it was indicated that 
students have to learn about jobs vicariously, that teachers are not pre- 
pared well c :h to instruct in the vocational area, and they lack adequate 
materials. Interdisciplinary teams and more help from guidance personnel 
were indicated to make the student's preparation for life more relevant. 
At that same conference. New Jersey Senator Williams criticized our delivery 
of services to handicapped persons even more vociferously. Senator Williams 
indicated that continuous hearings regarding the Rehabilitation Act of 1972, 
reveals that rehabilitation services are not doing their job. He indicated 
that difficult cases were not being served adc4uateiy, that many clients 
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were not being tre«^.well, and that services to the handicapped continued 
to miss the mark and do not meet the needs of the citizens. His speech 
proclaimed that we have rejected the rights of handicapped people, that we 
actually make them more handicapped by virtue of our^*" services, and despite 
legislation, handicapped children and adults are given only token services, 
Williams called for providing our handicapped citizens more of an opportunity 
to achieve their poteijtial. 

The RJaabili tation Amendments of 1973 that have finally passed Congress 
and are now before the President, call for more and better services to more 
handicapped citizens. The committee criticizing current and past services \y 
to our handicapped, reported that many persons are too readily considered 
to be of terminal employment level, relegated to workshops, and not given 
the opportunity to progress to a higher level of conmunit^j employment. 
Their recoomiendations attempt to assure these people of getting adequate 
s^vices so they can reach their maximum level gf vocational potential and 
functioning. 

Disenchantment with programs for all kinds of people continues to draw 
considerable attention throughout the country. I was pleased to learn 
there are a number of instructors, and counselors from correctio^l 
institutions, at this meeting. These institutions have certainly been the 
object of many demonstrations and revolts around the country from those 
claiming many injustices and lack of programs for inmates. Missouri recently 
had 63 prisoners at one facility bring suit against the Department of 
Corrections alleging poor treatment, vocational training, etc. On a recent 
field trip to that facility, I noted that there was only four "counselors" 
(with limited training) to meet the psycho-social-vocational needs of these 
ind ividuals . 
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\ There are many people in this country who say that education has not ^ 
done its job. The Pennsylvania decision and those since all assure retarded 
ana other handicapped children that they no longer will be excluded from 
school because they do not fit into the program. Instead, educational 
programs must fit the child rather than the child fitting the program as 
previously. Students, parents, inmates patients, college students, etc., 
are now demanding their rights and quality services and everrtually will get 
them. Changes in our funding systems are attempting to bring responsibility 
and accountability to the grass roots level where it should be. Hopefully, 
this will assure the delivery of the needed services. 

The new thrust today is toward Career Education-- for all people-and 
for all periods of life. Career education does not mean vocational education- 
it means total education for life including preparation for personal, social 
and econonic functioning. For teachers, it means they are going to have to 
become more aware of the world of work and design their educational efforts 
so what they teach is directly relevant to career functioning. No longer 
can we teach primarily academic skills with the anticipation that the student 
will somehow miraculously assimulate into society, secure satisfactory 
employment, and live happily ever after. No longer can education pass the 
buck and expect rehabilitation agencies to pick up the pieces and somehow 
prepare their students for some kind of job. Now, the responsibility rests 
with education as well as rehabilitation. If an individual still needs 
rehabilitation services after terminating his education, the likelihood of 
eventual success should bg^greater because that agency should now have an 
individual to work with who has a higher beginning functional level. No 
longer may we think only of dishwasher, janitor, salad girl, laundry worker, 
and the other traditional and restrictive jobs that handicapped students are 
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placed in. From now onv we must assume more responsibility for developing 
the potentials of these individuals to their fullest, so we better mset their 
needs and interests. This is the way I read the current tone of disenchantment 
with current services and what is going to be demanded. It means that not 
only do we redirect our own programs but we really initiate truly inter- 
disciplinary cooperation among the helping agencies. I don*t mean, for example, 
merely administrative arrangements between special education and the state 
vocational rehabilitation agency for QAP (work-study) programs as they are 
now in most instances being conducted. I mean utilizing the special expertise 
of personnel within the various agencies so direct client services are delivered 

to those that need them. 

/ 

Educational, rehabilitation, and correctional workers must be able to 
identify and develop the vocational interests and skills of the handicapped as 
early and accurately as possible. This doesn't occur magically ac any one 
point in time but is a developmental process. Vocational assessment or 
evaluation, as I prefer to call it, is still a relatively new and emerging arc 
that has a long way to go before it can be considered highly accurate. 
Currently, the Vocational Evaluation Work Adjustment Association is studying 
the speciality of vocational evaluation. Sixteen individuals have written 
position papers on various topics about vocational evaluation, practitioners 
are not responding to taese papers, and a workshop in May will try to pull 
together the current state of the art in vocational evalua^tion. 

During this workshop, you will have the opportunity to hear specifically 
about some of the major vocational evaluation systems that have been developed 
over the past few years. All have potential value for helping to assess the 
vocational potential of many types of handicapped persons. Howeveri I must 
stress that none are a panacea or can purport to accurately assess the vocational 
potential of every type of handicapped person. Therefore, it is very important 
for you to become knowledgeable about each system so you can make a judgment 
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about' the appropriateness for the people that vou work with. It is not mv 
intention to critique anv of the systems presented at this workshop because 
you will be able to Jo this by listening to the speakers that present each 
system and by observing the various components of them. Keep in mind th.it 
these vocational evaluation systems are a certain aspect of vocational 
evaluation, that is, each is primarily a work sample system. As I indicated 
Last year, I feel there is much more to vocational evaluation than the 
administration of work samples* However, each of these systems has been 
subjected to considerable developmental study and refinement, and those 
individuals who have developed them should be commended for their fine work. 

Let me give you a-.checklist of considerations that I feel you should make 
i when evaluating whether or not a particular system can meet your student's or 
client's needs. 

1) Does the system take into account expectancy to fail ? If your client 
has had a history of failure, it may be that by this time anything he tries, 

he expects to fail. Therefore, despite having the potential to perform a certain 
task this expectancy works against initial performance and he fails. For these 
individuals, the system should take into account this aspect and provide enough 
flexibility so that the conditions for failure are niinimized. 

2) Does the system take into account academic limitations ? It is important 
that a person taking work samples or any other vocational evaluation task is 

not beiri^ unduly penalized because of low academic capabilities. Thus, any task 
requiring sone academic performance should indicate what level is required 
to lio the task satisfactorily. 

3) Does the system take into account verbal 1 inri tations .! Many retarded 
and cultural Iv disadvantaged individuals are unable to express certain interests 
dPd kuov.r] edges despite the fact they have them. A system that does not allow 

or take into account these limitations maybe neglecting and not discovering 
O , important strengths, weaknesses, and potentiaj^-^^f such individuals* 

ERJC 



^) i>oes the system take into account limited Experience ? Fur many 
handicapped and disadvantaged persons > we cannot assume that they have been 
exposed to as many life experiences as the typical citizen. For example, 
certain common objects and places may be totally unfamiliar to these people. 
Therefore, it is important for the person administering the task to understand 
the client's experiential level and do the necessary pre-instruction before 
administering the task. 

5) Does the system allow for more than one trial on tasks ? Research on 
learning N(/ith the mentally retarded has discovered that frequently these 
individuals do much poorer on the first attempt but make Significantly greater 
gains duMng subsequent trials than "normal" persons. This research is 
extremely important because we may assume too quickly that a previous per- 
formance is too low for further consideration on a work activity that actually 
a client has potential for given enough tirre. 

^"^ i)oes the system allow for repeated instruction and cheek for comprehension ? 
This is particularly important for mentally retarded individuals as well as 
the emotionally disturbed or culturally deprived. A system that is too rigidly 
adhered to and lacks flexibility may be totally unfair to its c4ients. 

7) Does the system have face validity ? A system that looks interesting 
and is work-oriented, can be very motivating to its clients. However, many 
typical nuts and bolts and some mechanically oriented tasks often turn off a 
great number of people taking them. While these tasks may be very good for 
some individuals, for others they may be quite detrimental and non-revealing of 
their potentials and interests. 

Does the system allow for appropriate conditions for testing i.e. , 
rapport, pleasant surrounding, orderly administration, fatigue ? Enough cannot 
be said about these aspects of any testing situation which can completely 



^nvalidate the assessment. 
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9) nnP. the system .... ■'spaced" ra rhf^r than "massed" evaluation ? It is 
better to try to evaluate clients by distributing the various work tasks over a 
period of time rather than to cram them all in as quickly as possible. 

10) J^r -H.q ..aLlv normed on the handi capped and the workers who 
... Hnin. the varin..^^ tvoes of task^ nnd hn^ it rondnrted further foUow-uE 
studies of its vocational pred iction validity? 

It is difficult for to feel that there is any vocational assessment system 
that can accurately predict vocational potential. Vocational potential depends 
upon so many aspects of one's own personality and also the influence of ^ the 
family, community, and job site on one's functioning. However, a system that 
does oiake legitimate attempts to do the above should be of considerable valu^ 
in determining an individual's strengths, weaknesses, interests, and vocationa. 

potentials. ^ 

in addition to the value of vocational assessment alluded to previously, 
i.e., the assessment of vocational strengths,, weaknesses, interests, and 
potentials, there are several other reasons why vocational evaluajgp^an 
be extremely beneficial in Ly educational, rehabil itational . or correctional 
program. Some of the ones that I would like to list are the following: 
1) The student really starts thinking about jobs once he begins taking the 
vocational assessment battery. Sometimes, talking about jobs stimulates little 
interest in people and it isn't until they are confronted with an actual or 
simulated job to do that they really begin thinking seriously about their future 
and what they would like to do. 2) Job exploration can be initiated by conducting 
and administrating vocational assessments. The stident has the opportunity to 
try out a number of different types of work tasks that are related to a variety 
of job .-amilies which can prompt the student to do further reading on specific 
,ob. related to specific interests. 3) Actual simulations of real jobs can 
be brought into the classroom, rehabilitation facility, or institutional setting 

13 

20 



and tried out without any pressure. As I mentioned, many of our clients 
have a problem in the area of pressure, and in a more relaxed and non- 
threatening atmosphere, they can try the various tasks without any undue 
pressure. 4) Utilizing a vocational assessment system can be a meaningful 
deviation from the more traditional verbal activities of the classroom. 
Many handicapped people, particularly the retarded and disadvantaged are 
M\ore likely to enjoy and to be successful in more manipulative tasks and 
activities than the verbal ones that they encounter in a classroom situation, 
5) A vocational asse$sment system can act as a motivator to learn more 
academic material so they will qualify for specific jobs they are interested 
in. Too many times, former students regret 'not learning certain academic 
material while they were in school because such deficiency is now precluding 
any chances for the kind of work they would really like to do. 6) The 
vocational assessment system allows a method of comparing student abilities 
with those on actual jobs. Many times the teacher, evaluator, or vocational 
instructor are surprised how well a client is able to perform certain tasks/ 
jobs that people are actually doing, 7) Vocational assessment measures can be 
used as behavioral change instruments. For example, work habits, interpersonal 
relationships, cooperation, and other behaviors- that are required to satisfac torify 
perfotfT) different jobs may change when one is engaged in vocational assessment 
activities requiring these behaviors. 8) As an indicator of specific vocational 
strengths and weakensses, the school will still be able to develop such 
strengths and work on such weaknesses while the student is still there rather 
than finding out these problems near the end or after the program. This again 
can make the school program more meaningful -and individualized for each 
particular student. 9) Vocational assessment brings reality into the classroom 
and gives the student a reason for learning materials. He is able to see 
when confronted with actual vocational tasks why he has to be able to read, 
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write, compute, be aware of his surroundings, and appropriately relate to 
other individuals. 10) Vocational assessment tasks can be a builder of 
self-confidence and a different technique of learning. As mentioned earlier, 
the more verbal and abstract classroom material is, often very frustrating 
and self-debilitating to many handicapped individuals whereas perceptual-motor 
activities may often be much more appropriate. In fact, there is evidence 
that the skills required in school are different to those needed for satis- 
factory community adjustment, i.e., the same skills needed for academic 
success are not directly related to community success. 

None of us have really done enough to assure the successful adjustment 
of .the handicapped person into our complex society. If we think we have, 
we're kidding ourselves. Our services to these people have been desultory, 
and no pne really seems to know what the other person is doing for the 
individual, just what he thinks they're doing, I am currently doing an 
extensive study of former special education students, ^heir parents, employers, 
and various types of school personnel in a large Mid-Western city. Although 
I have not yet completely analyzed the results, preliminary inspection of the 

data appears to indicate that most of these 18-23 year* old former special 

i 

needs students are not adjusting satisfactorily to society and that they are 
not learning many of the skills felt necessary to learn in a high school progra 
Let's not have illusory ideas that we are doing all that is needed for our 
handicapped citizens. They need much more than we're currently giving them. 

If we are really concerned about our handicapped citizen, then many 
of our past failures can be minimized in the future by initiating a meaning- 
ful vocational assessment program to complement the fine accomplishments we 
have made in the academic and psycho-social development areas. Then we will 
really begin to meet the career education needs the handicapped so richly 
do serve to have met. 
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the time we try to put them into operational practice. Then,\if we look 
at a program and ask the program operators what they are doing, why they 



are doing it, and what they expect to accomplish by doing it, we encounter 
a bank of seinantic fog that clearly indicates that we really don't know much 
about either career development or vocational evaluation. We have some 



technologies available to us, but the linkages required to form thesa 
technologies into an operational system are lacking. 

In this presentation I would like to discuss career development, the 
role of vocational assessment in career development > and the application of 
commercially based assessment systems within career education programs. As 
I go through this presentation, I hope to be able to establish some linkages 
between our current state of theory and our current technologies. 



Career Development and Career Education 



Career development, as I understand it, is a lifelong developmental 



process which closely ties in with what has been called developmental counsel- 
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Ing. When we consider the ramifications of our careers on our total life 
styles, the Importance of career becomes obvious. Our status in the commun- 
ity is based largely upon our occupations; our income from the job we hold 
places constraints on many of our activities; the satisfaction we have with 
our job can affect our family lives; who we work with influences who we have 
for friends. Yet, if we stop to take stock off ourselves for a moment, and 
if we ask ourselves one question: "How did I get here?" we come up with an 
interesting finding. All of us are in this room, but I doubt that we could 
find many common elements in the sequence of events that brought us here. 
Instead we find a sequence of decisions and choices, some major, some minor, 
that brought us here. Some of these decisions were strongly influenced by 
chance or circumstances existing at a moment of time; others were th^ culmi- 
nation of a planned set of activities. But all of these decisions and 
choices had an effect upon our careers and on our being here. If we look 
into the future, we will be making other choices and decisions that will 
influence our careers. Some of us may decide to take aq advanced degree; 
others to take a certain civil service exam; others to have a child. 

Career development is something that extends over a lifetime and, most 
importantly, is a reflection of a series of choices and decisions we have 
made. At one level, decision making becomes the crucial dimension of career 
development. This is essentially the position taken by Tiedeman (1963) and 
Kroll, et 'al fl970). Onr:e we begin to consider the ingredients of a decision, 
particularly a vocational decision, we find that this is actually a rather 
broad approach that includes such things as self concept, need states, and 
other types of information. 

Clarke, et al (1965) have stated that there are two requirements for 
"good** decision making: (1) The person needs adequate information and (2) the 
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person/needs a strategy for processing the information to arrive at a 
decision. It is my contention that career development essentially Involves 
the person in a series of decisions in which he uses information about him- 
self aJd information about occupations and processes this information accord- 
ing to a set strategy to arrive at a choice. His "career development'^ 
sunmarizes the choices he has made. 

It is not my purpose to describe the career development process in any 
depth or to engage in a technical discussion of decision making in career 
development. If you care to go into this in more detail I would suggest 
reading a recent book by Kroll, et al (1970) who present a reasonably good 
discussion of these subjects. The point I would like to make is that when 
we talk about career education as something that ties into lifelong career 
development , we are basically talking about training a student to acquire 
information and to process that information to arrive at a valid choice. 
If we can accomplish those two goals, then we have provided the student with 
a generalizable skill that can be utilized throughout his entire life span. 

You will note that I said we should train the student to acquire infor- 
oation. One of the biggest shortcomings of current career education programs 
is that they are primarily occupational information programs that provide 
the student with information. This may be adequate during the school years, 
but it is inadequate over the long run. The way the labor market is changing, 
the way jc bs are changing, and the way careers are changing, we will have to 
produce students who have the capacity to deal with vocational crisis and 
make transitions into new careers (Adelson, 1970): Essentially career educa- 
tion becomes a means of teaching a student an approach to these future prob- 
blems by focusing upon decision making. 
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This will be a laora difficult task than It sesM slnct aost of us really 
don^t know liow to handle these career probleais. Ue have a substantial nuaber 
of unemployed teachers floundering around who are unable to select altema* 
tive careers. More drasattlcally, the recent collapse of the labor Mrfcet In 
the aerospace Imiustry confronted a substantial nuaber of hl^ly skilled 
people with a vocational crisis. An ewrgency federal prograa had to be 
Instituted t^o assist then. 

I have referred to the twro major requirements for good decision making, 
information and strategy. In the rMslnder of my discussion 1 will focus 
primarily upon the information component, and particularly upoh tixm role of 
vocational evaluation in career education programs. 

Vocational Assessment in Career Education 

By the time a stydent reaches thi secondary level he is required to 
make increasingly more specific career decisions. For example, he may be 
required to select a high school curriculum track or he my be required to 
select certain courees for his curriculum. To m^e informed choices such 
as these, the student already must have reached a point in his career devel* 
opment where he has made some broad, but tentative career choices. Students 
generally have reached this point by the early high school ye. ind are 
able to make adequate choices. 

It Is Important to recognize that the type of information required for 
these decisions is broader than merely information about Jobs, occupations, 
or courses. The student also has to have Information about himself. Typi- 
cally this information comes from two sources: his previous experiences 
and what we have told him about himself. This latter information can derive 
from course grades and standardized tests. 
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Xhe special needs student population presents some problems In a model 
of this sort. First of all, they generally do poorly on standardized tests. 
Secondly, we tend to discount their self evaluative statements since they 
are based on experiences that are dlffer^nr froio those of other students. 
Closely related to these Is a third problem of providing additional Infor- 
mation to the student. As decisions become more specific. Increasingly more 
Informatlon^tinieeded by the decision maker. Much^of this Information can 
be provided in written, spoken, or media form to the normal school population. 
However, as Reissman has m)ted, the special needs population liK:ludes a sub- 
stantlal number of individuals who acquire Information through the kinesthetic 
channel — via direct, hands-on experiences. (I should note that although 
this causes problems In the auditory and visual world of the school, the 
openness to direct bodily experiences Is an advantage in larcr vocational life 
and Is something that other studeats have to acquire.) 

Basically we need a component within the career education program that 
does at least three things: (1) provides us with vocationally relevant Infor- 
mation about the student; (2) provides the student with a set of experiences 
comparable to those of other students; (3) provides the student with a means 
of acquiring information about himself via direct, hands-on experience. A 
component that does these things may suffice to meet the limredlate, In-school 
problems of the special needs population. However, if we consider the life 
spari approach to career education, the problem of decision strategies emerges. 
Specifically, an effective strategy for choice involves examining the short 
and long run consequences of a choice. An appropriate educational goal would 
be: (4) provides a situation in which the student can. learn to test out the 
consequences of a choice. And if we reflect back to the need of the "normal" 
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student to learn to acquire information through direct experience, we can 
establish a fifth objective tor this career education component: (5) provides 
a situation in which the student can learn to evaluate himself on th^ basis 
of direct experience. These five objectives delimit an assessment component 
within a career education program that will provide information for school 
personnel and, more importantly, provide both a self assessment and learning 
situation for the student. 

Vocational evaluation using a work sample approach is a technology that 
can be used to attain these five goals in career education urograms. Specif- 
ically, work sample vocational evaluation programming can function as follows: 

(1) through observation of student performance and behavior on a series of 
work samples a trained vocational evaluator can assess vocationally 
relevant variables including abilities, interests, temperaments, and 
physical capacities. 

(2) by establishing a core set of work samples, representative of a wide 
range of occupational areas and job requirements, the evaluator can 
expose studenls to a comparable set of vocationally relevant experiences. 

(3) work samples provide a direct, hands-on experience for the student during 
which he can experience and feel what it is like to perform specific 
work tasks and to acquire information about his reactions to performing 
these tasks. 

f4) by providing the student with the opportunity to choose those work 

saniples he would like to perform, the vocational evaluator provides a 
situation in which the consequences of a vocational choice become 
immediately known to the student. 
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.(5) by providing the student with an opportunity to indicate his reactions 
to his performance and behavior on work samples and following this up 
with a statement of performance and behavior as seen by the evaluator, 
a learning situation for developing self evaluation abilities is estab- 
lished. 

The use of a work sample based vocational evaluation progi/am can attain 
these objectives within a career education program. In other words, the 
assessment component can extend beyond the obtaining of data about the stu-* 
dent and into the realm of providing the student with a learning situation 
in which he acquires basic skills that will facilitate vocational decision 
making in the future. 

I could go on to discuss some of the additional implications of voca- 
tional evaluation techniques in career education programs. However, I think 
some of the time available to me would be best spend discussing some of the 
traps people fall into in implementing vocational evaluation programs. 
Hopefully, by being aware of some of these traps, you will be able to avoid 
them. 

The first trap is program planning and budgeting. Vocational evaluation 
is one of the most expensive services that can be provided. A program such 
as that I described above is very expensive: the cheapest program that I 
could develop would handle about 180 students per year at a cost of $250 per 
student. Very frequently during the planning phase of the program the mis- 
take is made of determining the need for the program on the basis of an 
existing backlog of students who could benefit from it. This produces a 
nisleading figure. A more accurate figure is based on the projected rate 
at which new eligibles will be entering the system in the future. This 
provides a better estimate of whether there will be a sufficient number of 
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!iew oast's lo iu.stify operational costs. By the same token, the annual oper- 
ating buJget has to provide a^healthy amount for maintenance of work samples. 
In d work s.imple system you are using the same equipment over and over and 
it is bein« used by inexperienced students, this leads to equipment break- 
down and failure. Materials are being consumed and must be replaced. These 
equipment and material costs have to be included in the budget and added to"^ 
the expense of operating a program. 

Irap nu-.ber two relates to the program planning trap. Basically, trap 
two involves establishing a pi-ogram with too narrow a focus. Vocational 
evaluation is often regarded strictly as a substitute for psychometric test- 
ing with handicapped and disadvantaged groups. I indicated earlier that we 
can lonceptuali-^e vocational evaluation as assisting us to attain five career 
education objectives. Only one of these objectives refers to the psychometric 
issue; the remaining four relate to what the student can derive from 
evaluation,- Rather than narrowly focusing upon ourselves and how we can 
benefit, we should consider how students can benefit from evaluation. 
Oirte we take this point of view, vocational evaluation becomes an extension 
of uur -aroer education teaching component. It is applicable to a wider 
ranee .-f students, including the so-called "normal" student. 

Fro'^ran trap number three is the failure to provide for the implementa- 
tlor. of tht findings of the vocational evaluation program. Vocational eval- 

« 

uatioFi has tremendous implications for student curriculum planning. As the 
student experiences different occupations and jobs and comes to select future 
•OLat;..rMl ^,.als, lie also is able to determine the relevance of his academic 
co.irsf -ork tn attaining future goals. The student may, for example, discover 
(.hat he is interested in, and has the abilities for work as a machinist. 
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At the same time, since he has actually performed work tasks from this (Kcu- 
lution, he becomes aware of the fact that he needs math skills to be sucLess- 
tul as a -'kichinist* Our experience at Stout with evaluation programs for 
secondary school students has indicated that such a student is likely to show 
Loiprovement in his academic coursework, provided that the school makes changes 
in the student's curriculum to include vocationally relevant courses. 

There are two barriers to implementation of findings. The first barrier 
to implementation is that »'Ocational evaluation reports often do not contain 
the information necessary co translate recommendations into action. An 
evaluation report has to communicate and, in order to communicate, it has to 
be written from the frame of reference of report consumer — the person who 
has the responsibility for translating recommendations into action. Voca- 
tional evaluators frequently ask the question 'How do you write good reports?" 
The best way to answer this question is to ask the consumer what information 
he needs to implement the findings of evaluation. The report then becomes 
a medium for communicating this information. 

The second barrier to implementation is a failure to adequately prepare 
teachers and other school personnel for change. I have mentioned that voca- 
tional evaluation has tremendous implications for culrriculum development 
and change. Yet change, by its very nature, is threatening. It is one thing 
to talk of individualized instruction and meeting the individual needs of 
students I it is another thing to actually implement this programming. I 
have been greatly encouraged by the fact that schools can be extremely flex- 
ible in academic programming and accommodating to individual student needs. 
However this requires dh extensive amount of in-S(rvice training and 
individual conf erence<=; and staff ings to achieve. In other words, the staff 
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of the eviluation |>rogram have to be able to reach back into the school if 
the progra- is tu be successful. They cannot be confined to a simple assess- 
vvnt -iPii re'K>rt writing role. 

The fourth trap in evaluation programming is a failure to hire adequately 
trained vv^cational evaluation personnel. Once we begin to think in terms of 
the kind of career education vocational evaluation program I have outlined 
here, we have to give consideration to securing adequate staff. At this stage 
of development of vocational evaluation we have some sophisticated technology, 
but this technology is still only as good as the person using it. Trained 
and experienced vocational evaluators are in short supply and this manpower 
shortage will continue to persist, if not worsen, over the next several years. 
Vet we see school systems impose artificial hiring barriers, such ar requir- 
ing the evaluator to be teacher certified, that further restrict their poten- 
tial iiianpower supply. 

The fifth and last trap I will mention is the trap of not making adequate 
u?>e of existing knowledge in vocational evaluation. It may seem to many of 
you that the t.iin^s we are talking about are new and innovative. In fact 
they ire -tot. The use of work samples dates back to the early years of the 
centurv and, froui a technical point of view, work samples haven't changed 
nuch since the first Uorld War (Chapman, 1921). My own experience with voca- 
tic. a] e/a^ itiim i)ro^ra:Timing with secondary school students goes back over 
a decade, i.'e are currently seeing a resurgence of interest and the develop- 
rent of better service delivery models. However, we are indeed foolish if 
we ignore the experience and expertise of persons in the field of vocational 
evaluation bv applying the illusion\hat we are ''doing something new.'* 
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Commercially Available Work Sample Systems 
in Career Education Assessment Programs 

The failure to make use of existing expertise I just mentioned extends 
to the technology of work sample evaluation. There currently are three majov 
work sample systems available for purchases: the Jewish Employment and 
Vocational Service (JEVS) work samples, the TOWER system, and the SINGER/ 
Graflex vocational evaluation system, I have elsewhere compared these three 
systems on certain technical features (Dunn, 1972). Here I would like to 
make some other comments regarding the use of commercial systems in vocational 
assessment programs* 

The commercially available work sample systems have numerous advantages, 
particularly for a new vocational evaluation program. Not the least ot 
these advantages is that the developmental work has already been done for 
you. The work samples have been developed, field tested, de-bugged, and 
norms and scoring procedures have been established. Although the price of 
these systems may seem to be high, a recently completed study by the Research 
and Training Center at Stout suggests that it could cost you two to four times 
more to develop your own work sample evaluation system than what you would pay 
for a commercial system (Dunn, 1973). 

The question that comes up over and over is "which system should we 
buy?" The point to keep in mind is that the three systems are complementary , 
not mutually exclusive. Each system is best suited to attain certain goals. 
SINGER/Graflex is basically a vocational exploration system. TOWER is 
oriented toward vocational training areas. JEVS assists in assessing the 
level of vocational functioning of the student. Each of these goals is dis- 
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tinct and niav he ,ippro[>r late at a diffarent phase of a career education pro- 
gram. The declbior: as to which system or systems to purchase has to be a 

fiHK'tion of v.-Mr specific goals and objectives for the vocational evaluation 

prcgra^. I i a'l soo ,i role for all three systems. 

It is o!s\ to illw yourself to get distracted by extraneous factors 
iiid claims uiaJo tor a system. For example, the SINGER/Graf lex system has a 
slick i>aLkaue and certainly looks impressive. The JEVS system does not 
present this initial impact of sophistication. Experience with a system 
quickly reveals however, that what a system looks like doesn't have much 
relati(»nship to what it does. The packaging of a system can actually inter- 
fere with operation. SIXGER/Graflex is, particularly vulnprable to this. 
The uiels ]ook nice, but you find that you can't make very effective beha- 
vior observations of the student at work. The carrels also present problems 
fro .1 riuna-. factors engineering point of view (Munn, 1972). The Study- 
Mate used t(^ present the instructions is a good, durable machine for educa- 
tional applications, but it is prone to frequent breakdowns when subjected 
to the hard usage of vocational evaluation settings. The other systems 
have the/r i^irticnlar problems too. 

(■ne proi>lem thai particularly exists with the JEVS system is the ten- 
dcp^v of evihi iters to alter the sequence of administering the 28 work samples 
or to delete so-io of ti)e work samples from the bactery. Once you become 
fajiiliar vith Lh»^ ffCVS svstem you discover that, although it doesn't look 
verv inpressi/e on the surface, it is actually the most intricate, subtle, 
and sophisticated of the work sample systems. Altering the sequence of 
delivery of certain work samples, or failing to administer particular work 
samples, v-an alter the level of difficulty of other work s^{t)ples and also 
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result in a significant information loss. Because the JEVS system uses a 
graded series of \.7ork samples, you need the information from the lower level 
work samples to draw accurate conclusions from higher level work samples. 
This subtlety is often overlooked. 

As a general rule, a commerical work sample system shouldn't be modi- 
tied without good cause and without a careful examination of the consequences 
of the modification. A minor ctiange in instructions breaks the standardiza- 
tion of the system. The difficulty level of the task is altered and the 
norms are invalidated. Similarly, the. use of materials and tools other than 
those specified by the system has effects on the validity of obtained results. 

A major limitation of any of the work sample systems is that they are 
not completely comprehensive or totally applicable within a particular geo- 
graphical locale or school system. Consequently, consideration will ulti- 
mately be given to the development of additional work samples to fill in the 
gaps in the assessment program* ^One of the distinct advantages of the com- 
mercial systems is that they provide a foundation and model for additional 
work sample development. Knowledge of the basic structure and organization 
of any of the systems provides a good basis for the evaluator to determine 
the additional work samples needed and to secure the information necessary 
for work sample construction. 

To summarise, the commercial systems save time and woney during the 
initial establishment phase of the evaluation program. From this point of 
view they are a wise investment. Similarly, they provide the evaluation 
program with ct foundation and structure for additional work sample develop- 
ment. It should be recognized, however, that there are some limitations 
iv'ith the ctirrentlv .iv<iilable systems. \o one system will do everything for 
you and you have to think in terms nf how a particular system will assist 



you in attaining your career education goals. Tt is easy to be .uislead on 
this point and to believe that a single system is the answer to all of your 
problems. Finally, there is one point to be stressed again:; a vocational 
evaluation program, even one that uses commercial systems, iz still only 
as good as the person operating it. The commercial systems are tools of 
the evaluator. Unless the evaluator knows how to use these tools, and to 
coiTibine thetn with some of the other tools at his disposal, the svstem and 
the evaluation program is wasted. 



Dennis J. Dunn 
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The Singer Craflex System 

Stanley Hlenemann^ Consultant 
Graflex Education & Training Division 
3750 Monroe Avenue 
Rochester, flew York 14603 

Presented at the Iowa Invitational Workshop 
On Assessment Systems and Career Development Programs 

Council Bluffs, Iowa 
March 26-27, 1973 

The Singer Graflex System consists of ten work stations outfitted with 
a variety of industrial tools. The ten stations are; 

1. Basic loo Is 

2. Bench Assembly 

3. Drafting 

4. Klectrical Wiring 

5. plumbing ^ Pipe Fitting 

6. Carpentry & Woodworking 

7. Refrigeration, Heating and Air C-ndltioning 

8. Soldering and Welding 

9. Offiie and Sales Clerks 
10. \eedU- Irac!es 

An evaluatc^r manu il and evaluation forms are included which cover the 
procedures fur usinu the system. In addition, an instructional filtnstrip 
with a sound cartridge accompanies each work station. 

Each work station (36" w x 36'» d x 19'» h) is self-contained and is 
designed either to be self-standing (it has extension legs) or to sit on 
a desk top. For security and storage each work station can be completely 
enclosed and locked through the use of sliding panels inserted along rails 
^'oardering the exposed top and front of the work station. 
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Each work station is outfitted with tools appropriate to the work 
station function. In addition, an initial supply of consumable materials 
used in the work tasks is provided. The work station also has a Graflex 
Auto^Vance Study Mate rear screen sound/f ilmstrip projector mounted on the 
rear panel along with a remote control box for trainee operation. 

The work station can be moved to different locations. Therefore, 
arrangement of the portable work stations ^s flexible and a variety of 
physical set ups can be accommodated. 

The manual describes the background and purpose; the system and its 
components; and gives directions for utilizing the Graflex Vocational 
Evaluation System. 

Appropriate evaluation forms ave provided in the manual. In addition* 
an initial supply of forms are provided by Graflex as part of the system. 

The manual takes the evaluator through the program step*by*step, 
giving the suggested sequence of events and information on how to achieve 
most effective use of the system. 

Basically, the process involves: 

1. Orientation to the program 

2. Work Station I 

(a) Audiovisual (AV) Presentation of: 

1. How to operate machine 

2. Jobs related to that work station 

(b) Trainee rates interest based on AV' description 

(c) Work Station tasks directed by AV presentation 

(d) Trainee rates interest based on work experience 

(e) Trainee rates own performance of tasks 

(f) Evaluator rates trainee performance 
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U Kcpt-.u tor other work siaiiuns 
4, Trainee rates interest by pictures of jobs 

0. i.valuaior tabulates total interest 

6. Kvaluator brings together all available data to rate interest 
and performance and makes recomnendations 

ihe manual also contains inventory control lists of tools and materlaU 
supplied as part of the Graf lex Vocational Evaluation System. Each item is 
described and its quantity specified. 

Each station has its ovn films trip and tape cartridge for use by the 
trainee. Iliese are placed in the Graflex Auto-Vance Study Mate itounted on 
the back of the work station. The trainee controls the presentation via a 
remote control switch mounted on the right-front part of the work station* 
Trainee control is necessary for self -pacing. 

Problems presented by diverse reading levels are avoided. The progratoned 
instructions allow tiie system to be. used by illiterate participants with a 
minimum of evaluator assistance* 

ttie audiovisual presentation: 

1. Introduces the trainee to the tools of that work station and tells 
him how to use them. 

2. Describes a series of actual jobs related to the activities he will 
carry out at that work station. 

3. Instructs ihf. student step-by-step through the work station tasks 
which have been designed to replicate facets of jobs as found in an 
industrial setting. 

The Graflex Vocational Evaluation program is oriented to self«study« 
There are no rigid time limits. Usually^ however » the screening program can 
be completed in seven days. Both the trainee and evaluator participate in 
the assessment. Trainee evaluation of his own interests and aptitudes is 



combined with the instructor's assessment to form a definitive picture of 
job {;jr^lning direction ^st suitable for each client* 

The program engages the trainee in goal*directed work following a 
brief orientation. The evaluator observes the trainee's behavior in a 
variety of work tasks developed from descriptions found in the Dictionary 
of Occupational Titles* The unique feature of the system is the occupational 
exploration segment which helps the trainee determine interests by o^*^ cribing 
through audiovisual techniques a number of actual Jobs related to the work 
stations. 

, The Graflex Vocational Evaluation System is a direct result of Graflex' 
experience in training disadvantaged clients in a variety of programs: 
Job Corps Centers 

Vocational Rehabilitation Training Centers 
Correctional Programs 
N^BS/JOBS Programs 

The, Graf lex Training Division offers a full linc^ of services, curriculum 
materials, equipment, and management expertise for manpower development 
programs • 

price*purchase breakdown is shown below. 



SYSTEM PRICING 
THE SINGER VOCATIONAL EVALUATION SYSTEM 

FRCHXJCT # ITEM PRICE RANGE 

THE SINGER VOCATIONAL EVALUATION 
SYSTEM - COMPLETE WITH FVALUATORS' 
PACKAGE. AND ANY TEN (10) WORK- 
STATIONS, SELECTED FROM THE LIST From $8,666.00 to $10,344.00 



INSTALLATION/ORIENTATION -2-DAY 
PROGRAM (CONDUCTED BY SINGER/ 
GRAFLEX PERSONNEL)' 200.00 - 200.00 
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PRICE RANCH 



>[nPFL\'(; t HAK( LS - I'ROM MORTUX 
t^K'^'K, liirxOTS rO OHSTTNATION 



XXX, XX 



XXX. XX 



From $8,866.00 to $10,544.00 



IKiCL (VER U\'IT)^FOR SUPPLEMENTAL 

^ AhjuxfTTVE Work stations 



-ins 
-m > 

-)■'/: 

-I 

- J h 1 
I 1 > 

i L _ 
1 1 ' 



12, 
L U 



i>as 1 loo ] S 
'^ench Assenblv 

niewtyKal A'irlag 
lMir\hlM,tj; ^ Pipe Pitting 
V ir.'ei^trv cS VooJ^^'orking 

-U'fri^^eiMtion. Heatint^ i< Air Conditioning 

' Joi' 1 'It; ^ l-.'t i d i n^: 
i * i L t' '\ S'l ^ c'S Cltjrk 
'.eejiG irade.s 
''visonr V 

ShecL 'iet il Working 
^ onk I'lj tWik ii^y. 



9 872.00 
1,112.00 
849.00 
805.00 
<^47.00 
916.00 
791.00 
818.00 
850.00 
907.00 
853.00 
1,490.00 
1,490.00 

58.00 



I 'IS Lcil 1 a t lon/Or i en tat ion - 2-L)av Program 
ur .Ju.:(:ed by S in^er/Crra f lex Personnel) 



( Lsti Tiated K In^ iced) 



200. OD 
XXX. XX 



t s, a. ' i 



• 'nr^aise^ (^i ceM flO) or nu^re work-stations only.^ 
rer|M{pf,..| all Svstem purchases. 



St III t 1 > : 
i i ^ ) i ' 



i < )! i'iierurit of the above thirteen (13) work stations, 
'".ki/o mii t'\o Instil Lition/Orientation PrograTi, 
^ '"-'J* Vfuativ^nal Uvaluation System within a 



t ess 1 1 H ' 



"•^^ ' ' 1 u'-'.- bhi p pinc^ charges) 
* .''''^ ''.'ids s!,u,^"ip.r. charges) 
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The Singer Graflex System is applicable in: 

a. Vocational Rehabilitation Centers 

) 

b. Vocational/Technical Schools 

c. NABS /JOBS 'urograms 

d. Manpower Development & Training Centers ^ 

\ 

e. Correctional Programs 

f. Business and Tr,dustry Training Programs 

g. Labor Union Training Programs Job Corps Centers 

h. Community Training Programs 

The Graflex Education and Training Division will work with any organi-^a-, 
tion to tailor the Vocational Evaluation System to the customer' equirements 
and smoothly integrate it into existing programs. They will also work to 
develop individual stations or an entire system to meet particular tequire- 
meats. 
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IM- OF^ THK, SIXGFR SYSTF.M FOR CAREER EXPLORATION 

Donald J, Andersen 
Counsel or 

Hawkeye Institute of Technology-Waterloo 

and 

Bruce Stoll 
Special Needs Coordinator 
Hawkeye Institute of Technology-Waterloo 

Paper Presented at the loya Invitational Workshop 
On Assessment Systems and Career Development Programs 

Council Bluffs, Iowa 
March^26-27, 1973 

Vocational Technical Edg{:ation has for sometime tried to identify a 
means to predict student's probably success in programs. The majority of 
the instruments on the market are designed for the Academic Area. They 
measure Intelligence, Aptitudes, Personality, Interests, and so forth, but 
these are not totally relevant to our purpose. Motivation, dexterity, and 
ability to follow directions are far more important. 

We v/anted to see people do things with their minds and their hands. 
We wanted them to be able to project these activities into Career Choices 
or Educational Plans, We wanted an evaluation of something other than 
verbal behavior. We wanted to see how people behave under different 
circumstances. We wanted an opijortunity to discuss Career Plans in a 
relaxed a t/iosphere . The Siti^or Craflex rvaluation Syste.r provided -^.lany 
of these tilings., 

,e have used it in a slijhtiv different way than it's intended purpose. 
The skill evaluation for ea*.h stit'io-, ha? been secondary. The psychological 
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evaluations of how a person operates, perceives him or herself, and relates 
to the variety of tasks is primary. You might say the knowledge of Self 
has taken precedence over ail else. 

Hands-on experiences on the Singer are the Key to its success. Everyone 
likes to be involved with something. The exposure to a variety of occupational 
clusters gives insight into many things. The individual assesses himself in 
terms of:; 

1. Do I like it? 

2. Can I learn it? 

3. Is it something I would like to do for an extended period of time? 
These are the types of questions we hoped individuals would answer for 

themselves. We felt the Singer System would assist in this decision-making 
process . 

We have used the Singer System with a variety o^ people. It serves 
different purpo.es for each group. I will briefly discuss specific obser- 
vations on each population - 

A. Adult Women 

B. Youth (Boys and Girls) 7th Grades 

C. Pre-Career Students 

I). Drop-outs from Jr. High & Secondary Systems 

E. H.iidicapped 

F. Minorities (Black) 

G. AdulL Men (other than Minorities) 

A. ADULl WOMEN - The biggest value is the opportunity for them to discover 
non- traditional ireas of training and employment. Most Adult Women 
perceive themselves in traditional ro]«^. The experiences with 
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Woodworking, Wiring, Drafting, Soldering, Ktc. and success in thtsc 
areas stimulates thinking and opens a multitude of possibilities f(^r 
them. 

YOUTHS (BOYS 6. GIRLS) (7th Graders) - We had excellent success with 
this age group. The exploratory phase of Career Development is 
extremelv important for them, it gives relevance to the next 4 years 
of school, a tentative direction can be established. Here again the 
girls receive exposure to non- tradi tional Career Areas. There was a 
surprising contrast between their behavior at the station and their 
behavior in a Publ ic Educationa L environment . 

PRE-CAREER STUDENTS - Although A-G are all pre-career, there is a group 
of 18-20 year olds, who are a little unique. The Singer coupled with 
local business exposures provide a variety of information. This '^rou^i 
needs specific experiences relevant to where they are and vhere they 
want to go.; Extensive career counseling is involved with this group. 
DROP-OUTS (JR. SR. HIGH) - We must accept that not all youths will 
complete 12 years of traditional education. Therefore, it is j!npor*:ant 
to provide career direction and subsequent training prior to a^^e IS.. 
We operate an alternative school f^i. this population. A part of this 
Schooling requires exposure to the Sint;Gr. As a result many individuals 
have exptTiencerl success in sni^^ thing Lor the first time. It has 
let theci vioxj the Why \v of A'.aJemic Fducation relevant Lo a particular 
career choice. Ihev I'lonLify areas of interest through the use of 
extensive stip[^le"^entary materuls aivl proceed townrd'^ rralistic gi-als., 
MANDICAPPKr) - Depending on the pariicnlar c.ise, the Singer has been 
evtremely effective. Ihe basie tasks worked on, allow the individual 
success in career dusters with /'hi£'h they ire coT.rleteh* ui^ fami I j a r . 



It provi*.les the evaluator an opportunity to evaluate physical and mental 
limitations, and to provide counseling towards realistic areas. 
Vocational Rehabilitation has found this a good tool for their clients. 
MINOJRITIES (BUXCK) - Exposure to areas of career choices is particularly 
good.^ We have discovered that most Minority individuals are culturally 
deprived when it comes to basic usage and identification of tools. 
The Singer Program allows this needed experience to proceed at the 
individuals own pace. The supplemental career materials and exposure 
to training programs and jobs makes this a meaningful experience. 
ADULT MALES (Other than Minority^ - Most in this group have had at 
least limited exposure to many of these areas. Their initial approach 
is that it is menial and ridiculous: '*Kids Stuff." However, they do 
respond with considerable counseling and explanations of purpose. 
The ability to follow specific^ instructions and the subjective eval- 
uations obtained by the evaluator are valuable* They usually reverse 
the normal sequence by forcing the adult male to make some kind of choice 
before going through the stations. 

We have found the Singer Grai'lt-:: Evaluation System extremely valuable in 
Career Exploration and interest identification. This was our intent 
and it has for the niost part lived up to our expectations. We have 
discovered through it^s u^age that some areas are not covered or are 
not realistic enough. The biggest need is the development of a work 
station in mechanics. Although there if; some transfer of knowledge 
throue.h the use of various tools, the elecient of Mechanical Reason; -.g 
does not exist. a-lnilion to mechanics, we nee -something in Health 

Occupations, };] e^ ironi;. s , Animal and Plant Maragenent and some way to 
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get at the abstraction of manv other Technical fields. Wc Lave also 
aiscovt*re.l the depMi and focus of sonu^ carrel Is is rather shallow. 
Fortunately \>/e have at our disposal, 31 Career Vocational Technical 
programs to expand exploration activities. We are usin^ 6mm cassettes 
with tapes to further explore additional and moie specific areas. 

One example of unrealistic exposure would be the Welding Station, it 
is not realistic^ to simulate welding with a butane torch in a well lighted, 
air-conditioned building. Generally, if this is a high interest area for 
the individual, we will provide him with an actual experience in our welding 
career program for a short period of time, in addition, he will view 
several films describing M.I.G. and T.I.G. welding. He will also be exposed 
to the V.I.E.W. Sys/tem which has Micro-film cards detailing local information 



regarding employmer^t outlook, requirements, good and bad points, average 
wages, and where m/>re information can be obtained. This combination of 
experiences broadens the individual's outlook and provides adequate infor- 
'^lation to form realistic career plans. 

Administration or Supervision of the System is relatively sin.ple. We 
would recommend that the evaluator be trained in Counseling, He or she 
should also know or be able to learn, the workings of all the stations. 
This means proper use of all tools and equiprnent, rhe Evaluator should be 
a warm, empathetic, understanding person able to relate to all people. 
Students, especially, need reinforcement in their pursuit of a career. 
This reinforceriient needs to be well planned (Refer to counseling feedback 
I and II). 

The number of people worked with at any one time should not exceed (7) 
This is particularly true if there are time periods in between their 
completion of the station. In our case, we have between 30 and 40 people 
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working at various limes. Any more than 7 would mean some major scheduling 

problems. \ 

The problems with running stations lull is the varied times that the 

individuals require the evaluator. There are times with 1 stations going 

that (2) people are waiting or needing assistance. 

Tlie equipment involved is basically good. The tools for the most part 

are Sears Craftsmen and if thoy break, they are replaced at no charge. The 

Study Mate machine's major problem is the light bulbs* It is best to have 

(1) dozen bulbs on hand because of their short life. We have experienced some 

problems with the Audio and a few with the Inaudible signal. The controls 
(on-off) may cause problems, and if the switch breaks it is best to replace 
it with a toggle switch. 

Materials are best purchased locally. We have established supply 
sources in the Community for all materials* An example of local savings is 
the Credit Sales Tickets for the Office 6c Sales Clerk Station. Singer gets 
$100.00/1000. You can buy Master Charge tickets from your local bank at 
$12.00/1000. Another example would be the Drafting Vellum. Singer price 
is 100 sheets for $15.00. Our local price is $6.25. The pine, plyrW and 
dowels for 100 people by Singer costs ($201.40). Our local cost is $26.84. 
We must admit difficulty in understanding the reasoning by Si^-^er in their 
pricing of materials and supplies.. As ovmers of a $9,000.00 System, we 
feel that more competitive prices would be in order. 
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Counseling Feedback': ' I 

Pam ; \ 

You are a very charming and interesting voungyoman. You are the 
type of person people like to be around and do thing\ with. You are polite, 
usually enthusiastic, interested in people. You are mti^h more capable than 
you think you are. 

Although your central interest is now in nursing, your\econdary interest 
in clerical is no less significant, for many of the tasks of aVnurse are 
clerical in nature--making reports, keeping patients charts up t^ date, etc. 
Pam, I think you would make an exceptional nurse. In fact, I thirik you would 
be effective in any occupation dealing with people. 

Although you are really interested in only three of the tasks >ou got 
into at Hawkeye, you performed very well at all of the stations. You are 
very good with tools. That is important in nursing--especially if you 
become a surgical assistant. You are very precise and exact--another 
important quality. You are patient and per8istent--no less important. You 
are very neat and clean. You get along very well with people. Take algebra 
and chemistry in school, Pam, even if you may have to study very hard. 
Home economics would also be a beneficiTl subject., 

Pam, I am going to be very hone^,t -..Ith you. I don't think you are as 
confident as you are entitled to be. I don't know why. Perhaps people 
have been too critical of you, failed to give you che encouragement vou need- 
encouragement every young person needs. Because you lack self-confidence 
you hold back, are reluctant to really get involved in things. An l because 
you hesitate or don't get-with the things vou do, you don't do as well as 
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you could. And conlidence comes from being successful. It's hind of 
circular, as you can see. 

To start with, pick one subject and really get into it. You will have 
to make the first step and then the people you work with will start encouraging 
you to go turther, "get into it" even more. Don't hesitate to ask your parents 
and teachers to help you. Talk all this over with some adult you get alx)ng well 
with. You have plenty of natural ability. You're going to have to learn not 
to be afraid to use it, test it, develop it. Don't be quite so cautious, open 
up, become more aggresive and daring. If you hold back you don't run as much 
risk of failing but you loose a lot of opportunities to succeed, too. Tell 
people you want to make it. Tell yourself you want to make it. Socm all 
of you will start believing it and already do. 

Don 




Counseling Feedback: II 



Chris; 



Wow! 



You get turneii on to just about everything, don't you. With the 



exception of sewing. Even this you don't dislike, though. 

You are a very refreshing, warm and sociable young man. I really 
enjoyed working with you. I like people who have so much energy they don*t 
really know what to do with all of it. Your good nature will carry you a 
long way. 

Although it is difficult to tell by your responses which task you 
liked the best (your interest was high in everything) they do indicate that 
you are interested in active things, in doing things. You ray not be happy 
with a desk job, anything in which you spend alot of time in one position. 
Even here we can't be certain though, for you had a very high interest in 
both drafting and clerical tasks, jobs in which you would be content in 
a job in which you were inactive for long periods of time. This need.to 
be active probably gets you In a little trouble at school, doesn't it? 

Anyone with as much energy as you have, Chris, will have a little 
probleni. I guess, a pretty serious one, if you don't know how to learn to 
control and concentrate it. You iTiay never become very good at anything 
until you do learn to control it. If you do, there may be little that you 
can't do. But, what do I mean by control » huh? l^at we're driving at is 
your learning how to control yourself. Imagine yourself, for a mo^^ent as 
a young horse. Have you ever seen a colt on a spring day bucking, kicking 
up its heels, rolling around on the ground* running back and forth across 




I he pasture until ii is Just exhausted. Now apart from enjoying itself what 
has the colt accomplished, other than getting tired. Very little. Compare 
this colt to a stallion responsible for the survival of a wild herd of horsM* 
He is constantly on the alert for approaching danger* He is capable of leading 
the herd to good grazing land. He can ward off competing stallions with very 
skillful combat strategy. He can keep the herd in a tight group where they 
have the protection of numbers. That stallion can control himself* Oh! He 
may kick up his heels once in a while, run just for the joy of running, but 
when he has to he can do just what he wants to do. He has a purpose and he 
can control his movements well enough to attain that purpose* 

People go through this same thing in learning how to do something. 
They learn how to control themselves. That stallion learned how to defend 
himself by developing combat skills. You have to do this too, Chris. You 
probably know how to ride a bike. Before you tried didn't you watch how a 
skillful rider did it? When you began, you had a goal which you could 
imagine--skillfully riding a bike. You had seen others do it but you didn't 
quite know how they did it. Right off the bat, you probably fell down. 
Slowly, after a few bumps you learned how to balance yourself. You learned 
how to use Che pedals, how to brake, how far to lean when you turned a 
corner, how to stay upright when you stopped. You learned a very complex 
skill by learning how co control yourself. Every skill you pick up, Chris, 
is dependent on your learning how to control yourself. This goes for math, 
English, welding, drawing, writing, walking, running, sawing, threading, 
everything. There is always a goal you are reaching for first, then, step 
by step you learn how to reach that goal. We will talk about this, Chris, 
the next tin.e we get together. Hang in there! 
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SINGER/GRAFLEX SYSTEM - ITS USE IN CORRECTIONAL PROGRAMS IN WISCONSIN 



\ 



Rlcardo G« Cerna 
Vocational Evaluator 
Wisconsin State Prison 

r Paper Presented at the Iowa Invitational Workshop 
On Assessment Systems and Career Development Prc^rams 

Council Bluf£e, lorn 
Harrh 26-27, 1973 

HISTORICAL DEVELOPMENT 

Ihe Wisconsin Division of Vocational Rehabilitation has been serving 
inmates and parolees of Wisconsin's correctional instititions for a number 
of years. However, prior to 1964, this involvement wis limited and primarily 
\ concerned with problems associated with physical disabilities such as 
^^chaslng artificial lind>s, hearing aids and other medlcal^surglcal services 
whl^ could not be provided through the Division of Corrections* programs. 

In 1964, the first pilot program between the Wisconsin Division of 
Vocational Rehabilitation and Wisconsin's Division of Corrections was begun. 

In 1966, the first full-time D.V.R. counselor was assigned to a 
correctional institution. 

In 1967, other counselors ^^ce assigned to other correctional institutions 
and a full-time central office supervisory position was developed to deal 
with the development and itnplementation of correctional rehabilitation programs. 

1968 was an experimental year. A number of cooperative programs in 
several areas of vocational training were developed. It was also in 1968 that 
the concept of establishing a pre-vocational evaluation center at a ju- 
venile receiving center was discussed. It was felt that by establishing 

/ 

I 

' 51 



ERIC 57/ 



vocational evaluation and counseling services at the reception center, a 

more complete D.V.R. file could be established, providing for better services. 

In August of 1970, the first full-time vocational evaluator was emploNcd 
by D.V.R. The task was to develop and implement an evaluation unit at 
Lincoln Boys School, a reception center serving the northern 42 counties oi 
the state of Wisconsin. 

During*^1971„ D.V.R. became involved in the development of the Assessa^ent 
and Evaluation Centers being formed by the Division of Corrections. The 
Assessment and Evaluation Centers were placed into operation at both 
Wisconsin State Prisons, Wisconsin State Prison (W.S.P.) and Wisconsin 
State Reformatory (W.S.R.) in October, 1972. It was at this time that 
a vocational evaluation lab at W.S.R. was r.taffed and equipped by D.V.R.: 
and began functioning as part of the program. The lab at W.S.R.: started 
functioning as part of the A 6c E program in January, 1973. 

PROGRAM AT LIN'COLX BOYS SCHOOL 

The task '*>f developing an evaluation lab at Lincoln Boys School [^rv.i(-: 
to be a very interesting and challenging operation. This was because there 
.vero several concepts as to what an evaluation unit was, what it was supposed 
tc- Jo di\d how it was t:(^ operate. 

Ihe first step at Lincoln Boys School was to construct work sample.-^ 
and Jevelnp a progran of vocational evaluation that would meet the needb 
of clients - males r a^es i3-].S years mostly from rural areas c>t iVi scons 
It was. f^ot until approximately a year later that 1).V.R.>, was able to purchi.M^ 
a Sin^er/Craflex System for use at the school y 

Prior to acquirin'4 the S/C System, a study was done to determine if 
trie vu^ational caluation results c^btained during the boy's secon{i week 
^-i^'^^^iy tlie sclioo] were valid. A grcnip of '35 boys was re-tested six 



th) vvt'ek^> Utt-r tht' liuCi.U e^aliKition. Tht^ results indicated that a]thou>;h 
t:iort' a'a i 'u^r^^v e"ic'i t in ti performance, this imprr-vement was very 
. i icr. I . U increased in predictable curve, so it vv^as decided to keep 
the e^aluatii'H at the hev^iP.nip.K of the boy's incarceration. The [iro^rar- 
calied tt^r ewi huit ing 'al 1 boys, ages 13 through 18 years, coming into the 
1 n.^ t i tut Kv. . fho results of the evaluation were then used to help set up 
an indivi'Jual program fc^r each boy. 

Because of the two types of work samples available - the ones constructed 
during the first year and tne S/G System - there was an opportunity to evaludte 
student perfornan^e on each type. Keeping in mind that work samples are 
opIv pwe of the tools used during evaluation, the following observations 
u'crc -^ade;^ 

Ihe S^c; Syste 1 had a ^uch greater face validity. The students responded 
•'ore positively to the S/G samples t^an to other work samples with possible 
exception of the srn.all engine work s^^mnle. 

The S/G Svste". also provided excellent pre-vocational information on 
the differep.t job areas, information thdt was not built in the constructed 
.vi^rk sa iplcs . 

\s a result of the fa^e validity and the information provided by the 
S>vSte'V, the student^ were able tt^ associate far better the work sample 
per forriariL c with the actual jobs. The evaluation became more meaningful 
to the"^. Once an interest area was noticed, other instruments and more 
specitiL samples^ were used to provide additional information. 

iniring the ti^e that "ost ] ') throusih 13 year olds were evaluated, 
so eril fa^t^s .a'e intt^ lights 

'}pe '.MS that the rujoritv pf the students were returning to a school 
t' .u\lele tlicir edi'd at lOPi. In this case, a vocational evaluation 
s(rie.v'hat pre-^iature as vocational interests changed as the student 
I i' meed IP school and was exposed to other area:, of work. 

ERLC ^ 



''^ '^'^^ NtUiic'its soon in the lal) IkkJ, at best, a -fry li itvd 
,cv\ c'. .HTii-.o-., ^.r lliis, tho' < <; cii.i a:i i' .rllcnt job of prt> jdin- 
5 '--t i.>b ircas, bv!t tlu' iuh\hef v) t" areas was iinuted. 

ibree\, a:Hi .n^ssiblv the ru^st striking fact was that the ;<rcat 
..aiuritv ot stuacnts Ihul tt^e capabilities of perforining most entr% level 
K^o tJsks tfiat arc ropreseiUa 1 1 vo of the work samples. With proper trainini;, 
trie najoritv of these students could handle a skill job. The kev to all this 
^•^^^ ^ teres t aivJ :)otivatioa . 

Tour, because the i2;reat Pajority of the students had these capabilities, 
the ovaluatio-. results, as far as v6cationaI goals were concerned, were beini^ 
.'landed. liuit is, it was soPiewhat premature to make long range vocationaJ 
^'.vil^^c Si'^.e the results of the evaluation were being used for progra^iinj ng 
^luJent-, there were manv i)rograp changes resulting from changing interests. 

4owever, there .vas a group that benefited greatly from, an evaluation. 
nie<;e -verc the slow or reluctant learner, the boarderline retarded, the 
sLKiali. or .uiturailv deprived, as well as those highly unmotivated toward 
ir\ of <^ch(H>l trai[iing. ThebC students were in the minority ol the 

'jv'v- "-.[umI :n^pu 1 at io^^ 
1 K i 'ifiUa 1 I y , the school bocanie t t^-euo l a t i ona I on June 1st, l^'l'l, 
"-Kt ei-ii i>f rfu ^'.ir's we>-e i-^ ed t'nrough the' program and no' signiiicaiU 
itt.. reve'> -r ir^;]^' ^ wore (^bser*eJ. 

^ re:<'lt -f o'aUiiti'' i the ,^rogr'-,. evaluation ot \ 1^) thrcM.gU 
■ ^'^^ ol'l^. ' I i 1 WIS slowed do\r:. L/Mihasi-^ was placed on those 
u-w. wf)o c,.,t on an i ndePeiu'e L placement, or were not t(^ Lontipue 

' '''''''^ .r-Ti'. :ht e/aliMLioM i^ro^r ' s, st.ill available -it an\ t i pie 



PROOR.-\MS \\ lv.S.F, o; W.S.R. 

During 1971, the Wisconsin Division of Vocational Rehabilitation became 
iiuolved in '■he development cf the Assessment and Evaluation (A & E) 
Centers being developed by the Di^/ision of Corrections, The objective of 
the Centers was to provide a program of assessment and evaluation for each 
offender ui*utted (both new and re-admission) to the Prison and Reformatory. 

The A 6c E' programs began operation at both the W.S.P. 6c W.S.R. centers 
on October b, 1972. The programs are designed to provide a more meaningful 
and coordinated approach to the treatment of each offender admitted to the 
Prison Arid the Reformatory by informing, motivating, and evaluating him at 
the beginning of his incarceration. Each offender is involved in the 
development of his own case plan which utilizes bot*h short and long range 
i;oa I s . 

L),A".R.'s primary objective is to determine tiie number of clients who 
need vocational rehabilitation services related to the A 6 E process and 
to identify the other kinds of services that should be provided. 

D.V.R. has equipped and staffed the A 6 E vocational evaluation labs at 
W.S.P and W.S.R. , as well as provide a counselor and counselor's aide to 
work in cooperation with the Division of Corrections staff at both A 6c E 
centers . 

Ihe S/G Systent was chosen to equip the labs because of the positive 
experiences with it at Lincoln Boys School. The idea was to use it as 
a core set of samples and that more specific work samples would be developed 
as needed. 

At the present time, ap])roxima tely half of the men being admitted 
are scheduled for vocational evaluation. These men are selected to go 
Lhrou'.^h tlie evaluation lab by the D..V.R. counselor if he feels that there 
is i\ot enough vocational information to make a tentative rehabilitation 
plan. However, other members of the A 5^ E staff can also recommend men 



tor- evaluation.. Dthc-r innates alreadv in the prison population can also be 
reterred tor evaluation by their social worker or re-classification 
vo i Ltee. 

The present schedule calls for medical and dental exanina tioius as 
u'c-U as orientation the first week. Interviews by D.V.R. and the securit> 
coordinator and acadenic, vocational evaluation begins the third week, if 
the man is scheduled for it, and finally staffing is started on Thursday of 
the fourth week. 

Results from the California Achievement Test (CAT) and the General 
Aptitude Test Battery (GATB) are available on all men coming through the 
vocational evaluation lab. In many cases, these results are low, though r.ot 
all nen with low results can be classified as retarded (mentally). Many 
of these men have not had a good work record and certainly most have no 
salable skills. 

The men are scheduled for a four day evaluation. So far, only one 
in..ate has refused to go through the evaluation." The overall response from 
these men has been very positive and the program is seen by most as an 
honest program, working in their behalf. 

The S/C; ,Syste:! is used both to present job information as well as 
to evaluate interest and ability. Other evaluation tools such as the 
interview, aptitude tests, and interest inventories are used as needed. 
However, the mere fact that a man goes through the S/r; System and the 
appropriate ratings are given, does not mean that he comes out with a 
vocational label and a ready-made answer to his vocational problems. 
! ike with any type of evaluation, observation is the ke^ word. 
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A brief report i*s written after an inmate has completed the 
evaluation. It is used together with other reports by the security 
coordinator, program coordinator, guidance counselor, D.V.R. counselor 
and a summary of test results at the staffing to help determine an appropriate 
plan. 

The evaluation report includes a summary of job sample results, 
observation of critical behaviof and recommendations. The lab report seems 
to provide the additional information needed to help determine individual 
programs . 

Usually six men are scheduled each week, although as many as eight 
and as low as three have been scheduled. Six seems to be the number of 
men that can be handled by one evaluator in the S/G System without many 
problems. The main problem in scheduling seven or ^ore individuals is that 
after the first two stations are completed, scheduling becomes somewhat of 
a problem. This is because of different work speeds; and the problem is 
that usually a man has to spend some time waiting for a station to open up. 
Also, because of numbers, time spent in direct observation is reduced. 

The fact that only six men are scheduled per week has posed no problem 
at W.S.P. because intake has averaged about 12 or 14. Approximately only 
half of the intake population shows a need for vocational evaluation. At 
W.S.P., the S/G System seems well accepted by the inmates. Reports from 
V;.S.R. also indicate that response has been positive. The positive response 
to the S/g System could well be due to the fact that it does not present 
them with another opportunity for failure, ^tany of these men, could be said, 
to suffer from what has been called the "failure syndrom"* Where they cannot 
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perform academically, they can at least perform with their hands. The 
S'/Q System does not present a threat to them. It also has face validity, 
and the men feel that it is a program that is beneficial to them. 

So fir, no major mechanical problems have occurred. The men have 
left the operation of the system to the staff - that is, the changing of 
tapes, film strips, adjustments, etc. Operational cost of consumable supplies 
per man ha? been reduced to approximately $2, The biggest alterations have 
beenf (1) the painting of tool outlines; (2) securing the hooks to the pegboard 
with wire; (3) use of a card and time clock for recording time and ;^ (4) 
modification of the blue response sheet to show the errors the evaluator 
checks for. 

Time norms liave nut been established for the population at W.S.P. 
These tine norms are very different than the ones provided with the S/G 
System. However, the S/G System is being used only as a tool for evaluation 
and as a tool, it is only as good as what you make it. 



Ricardo G. Cerna 
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THE USE OF SINGER GRAFLEX WITH THE MENTALLY RETARDED 

Richard Schoonover 
Director of the Pottawattamie Career Evaluation Project 

Paper Presented at the Iowa Invitational Workshop 
On Assessment Systems and Career Development Programs 

Council Bluffs J Iowa 
March 26-27, 1973 

1 would like to visit with you today about our application of the 
Singer/Graflex Evaluation System, The system is being utilized as part 
of a Special Needs (P.L- 90-576) project serving the mentally retarded in 
Harrison, Shelby, Cass, Pottawattamie, Mills, Fremont and Page counties. 
These sev^n counties make up the Area XIII educational structure in 
southwest Iowa. We are serving 24 school districts within these counties 
and we will have served about 180 students throughout the area by the end 
of June* 

We are using the Singer/Graflex System in conjunction with our staff 
to satisfy these program objectives: 
Modification of Curriculum 

Increased Student Awareness of Career Options 

Increased Teacher Awareness of Student Potential 

Increased Information for Vocational Rehabilitation Services 

Each of the agencies involved keep us informed of the use they make of the 
evaluations- With this information, we then can modify our program as 
needed . 

The Singer/Graflex System is housed in an 8 foot x 35 foot mobile unit. 
This unit is transported between school districts for completing evaluations. 
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The whole procedure actually began when the individual school districts 
elected to participate in the project. At that time, an evaluation schedule 
was developed that indicated the dates for each school's evaluation. The 
amount of time spent in each school was dependent upon how many educable 
mentally handicapped students that school enrolled in comparison to the 
total Area XIII educable mentally handicapped enrollment population. 
Because of the number of schools participating, and the difficulty in 
scheduling, it was necessary to combine some school districts. 

Prior to the evaluation, we asked the school staff to tell us what they 
would like to know about each student. In addition to this, we asked for 
the student's age, his IQ score, his reading level and his math level. We 
also asked for the student's past history in school and medical problems, if 
any. By studying this information, we have a better idea of which stations 
to use in evaluating the student. During the evaluation, our unit evaluator 
observes the student's performance and work skills. We are just as 
interested in how the student performs the task as we are in what the final 
product looks like. We observe the time very closely in the office unit and 
in the bench assembly station and make a note of this time on the final 
report. 

A final report is prepared on the student's performance in each station. 
After the student completes the evaluation schedule, which usually consists 
ot 6 to 3 stations, the evaluator will write up the final draft of the 
ev^aluation report. This report is then typed onto a form which briefly 
describes what e^ch station evaluates and below this description is 
how the student performed in that station. The unit evaluator also writes a 
su-^mary wherein he gives his overall impressions of the student's occupational 
maturity. Our evaluator takes into account interest, attitude, performance 
and quality of the final product in preparing this report. 
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Altor tiu'' fV.iluitiH" ^.o'lj^letes llu'' cwluation report, \w K,ives it to 
'it: anil I prepare a curriculum modification report to acccviipany this*report. 
Most of the curriculum recommendations are based upon information supplied 
ti^ e bv the teachers. Prior to evaluation, we ask each teacher to prepare 
a daily schedule and a curriculum report on each child. By studying these 
reports, I can determine the academic areas of the student. With this 
information and what I can glean from the Singer/Gra f lex evaluation in 
re.^ards to measurement skill, alphabetizing and' work habits, I can, then, 
' prepare a series of recommendations. 

I am encouraging the adoption of a career oriented curriculum where 
each area taught is built around the "world of work," The schools are being 
encouraged to use their communities as a resource in developing work 
experience and work study programs. The vocational rehabilitation counselors 
ire contributing a lot to this particular area. I also assist the teachers 
with adapting the recommendations to their teaching situation. In addition, 
I also make recommendations on teaching approaches to be used with a particular 
child and encourage the selected placement of the special education child 
into regular classes; and, if placement is not possible, I encourage them 
tc^ develop an independent study unit lor the student. 

After the two reports are completed, they are distributed to the school 
s>ytem, tlic vocational rehabilitation counselor and the county superintendent's 
office. We also hold a staffing with each school to review the evaluations 
and to come to some type of conclusion about each child. I will return to 
that school district about once every six weeks to assist with the implementation 
of reco'nmendat ions and in any other area that might arise. I also visit with 
adriin is tra t ion and guidance counselors concerning what additional programs 
tliey '^Luhc c)ffer to' the special education student. 
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During the first year of the project, we have concentrated on the 
educable mentally handicapped student. Most of these students are enrolled 
in special education classes, although some are integrated into the rev^ular 
classroom, 1 encourage some integration for all the students^ part icularlv 
in the area of vocational classes. 

We are not attempting to identify future welders or air conditioner 
repairmen. We are only trying to determine the student's level of 
vocational maturit and development. By evaluating the student, we can ^ive 
the school an idea of where he is vocationally and what skills must still 
be developed. We feel this has been a profitable experience for the 37 
girls and 101 boys who have completed the evaluation, as well as for each 
school district involved in the project. 



Richard Schoonover 




Richard Keir 
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JEVS 

H. Kulman, F. Drachman, and F, Stabene 
Vocational Research Institute 
1913 Walnut Street 
Philadelphia, PA. 19103 

Presented at the Iowa Invitational Workshop 
on Assessment Systems and Career Development Programs 

Council Bluffs y Iowa 
March 26*27, 1973 

The Philadelphia JEVS Work Sample Battery consists of 28 tasks or 
samples • These samples are actual work activities performed in a simulated 
work setting. They are administered to clients from the easiest to the most 
difficult, and are thus arranged in a hierarchy of complexity. Sampling 
is completed when the client has performed all 28 of the tasks, or when 
he is no longer able to perform satisfactorily. 

This system of vocational evaluation is particularly effective when 
dealing with clients who have low reading levels or problems coping with 
paper and pencil tests. To minimize work pressures, the required reading 
level of each sample Is kept at about the 4th grade level. Clients are not 
pressured to work on samples which they do not want to perform. 

Work-samples expose clients to a variety of vocational possibilities* 
As a result of sampling, Interest and work-related behaviors are observed, 
and a job-related performance evaluation Is achieved. 

All the work samples are related to Volume II of the Dictionary of 
Occupational Titles. Each work sample has a functional relationship to 
the Date, People, Things hierarchy of the Dictionary of Occupational Titles, 
and Is therefore, classified In a specific Worker Trait Group Arrangement. 
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111 an i-rientation prior to work sampling, the client is made aware 
that he shouLi work as quickly as possible, and that he should perform each 
sample as accurately as he can. The client can take as long as he needs to 
perform the individual samples. There is no prior time limit set for his 
completing it. However, his time for completion and the quality of his 
performance is compared with pre-established norms based upon tlie performance 
of bis peers. 

Currently, work samples have proven useful in a variety of settings. 
These include: 

1. Public Schools 

2. Private Schools 

3. Vocational Rehabilitation Centers 

4. State Employment Ser^ ice 

5. Correctional Institutions 

6. Work Adjustment Programs 

7. State Hospitals 

8. Veterans Hospitals 

9. University Training Centers 

10. Private Vocational Evaluation Programs 

Ongoing research and innovations are part of the Philadelphia JEVS Work 
Sample Program. Recently, a research project uas completed which supported 
the efficacy of using work samples as an asj,essment technique with hard-to- 
place clients. Current research is directed toward developing new Work 
Saniples in areas of work not covered by the present battery. Seven samples 
are under consideration, and four are completed. Although prospective units 
are encouraged to develop their own time and quality norms' through guidelines 
and statistical procedures outlined by the Philadelphia JEVS, a current 
set of scales developed within the last six months is available for use. 

64 

71 . 



These new scales are easier to interpret and more meaningful to those 

using the system. An entire revamping of the reporting system (forms for 

observing, recording, and analyzing the data) has been undertaken in recent 

months. This new system is now being utilized in all field units. A new 

Handbook for Evaluators and Supervisors has just been released and is also 

being utilized by all field units. This Handbook includes changes in 

administration and scoring of the samples, as well as the changes in norms. 

Included are pictorial representatives of common errors and correct assembly 

of samples. Frequent scoring questions and procedures for handling 

problem situations are also covered. 

Thiw Work Sample System is available only through the Philadelphia 

JEVS. For information contact: 

Harold V. Kulman, Director 
Vocational Res«iarch Institute 
of the 

Jewish Employment and Vocational Service 

1913 Walnut Street 

Philadelphia, Pennsylvania 19103 

Currently, cost figures for the Philadelphia JEVi> Work Sample 
Battery include: 

- Work Sample Hardware and Forms required 

to evaluate 15 clients simultaneously.*^ $ 4,000 

- Shipping and Handling Charges 250 

- Two week training in Philadelphia at 

$600 per person (minimum one (1) person 600 

- Four (4) Tecanical Assistance visits 
throughout contract year. ... 4 days 
per visit. Room charges, food expenses, 

and consulting fee ♦ . . 2>240 

rOTAL $ 7,090 
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Uni'ts that have their own time equipment iwav ileuLi. t \ \ , 
ti-ie clock) and S190.00 (for a time stamp) from the harJviu ^ ^ ^ i i 

Depending upon the aequisition of our anti*. i pated SKS .tit t'u 
rhiladelj-riis J.E,\\S.:, units having government affil I Ui\>n ■.•ith 
Jepartnent of Health, Education and Welfare, -^nv dedu. t - , ; ■ ■ 
^. har^res for "lechnical Assistance. 



Harold Kulf^ian 
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iho Ji:V,S .System in a Community College 

I;ennis Krehbiel 
Pirector of Career F.valuation Center 
[)es "-Unnes Area Community. College 
iOOb Ankeny Boulevard 
Ankeny , Iowa 50021 

Presented at the Iowa Invitational Workshop 
on Assessment Systems and Career Development Programs 

Council Bluffs, Iowa 
>ittTch 26-27, 1973 



iiie Des Moines Area Community College has used the JEVS System as a part 
of Its Career Exploratio n Center for about three years. In order for you to 
have a better understanding of how we use the system and why we made some 
adaptations, 1 want to give you some background on the total Career Exploration 
Center Program, 

The career Exploration Center (CEC) is a work evaluation and exploration 
nrogra^M.^ Our objective is to assist people in Identifying t.heir abilities, 
skills, and interests and then to guide them toward meaningful employment. We 
lu^t tMilv wait to help them learn what kind of work they would like to do but 
what thev can do best, 

Wov does lYX accomplish this 'J Through the fo' components that make up 
the evaluation-exploration program. They are:' work exploration, educational 
e-abiation, iKVS and counseling, 

Ihe work ex-piorition component is a hands-on experience in numerous jobs, 
'>.'c have four occupational groups where exploration is possible; Business, 
' rai'hies,^ 1 iidus t r 1 al - ^lech.inie al and Service Occupations, In each of these 
o 1 . ri t ] < -n arc is is equipment ind ii.iteriils for our students to get their hands 
' a ^'1 ^i't., iho'/ arj ^iven job tasks or work samples that simulates a real 

t'^' >: 'I'ir^'i'h this pr^^ccss the student can learn the pros and cons of a 
u I ■ I e V i r i e t V o i o t m : ^.i t i n n »^ 
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lu" i d\u ii iouaI tvaluatKMi component is used lo dtuerrune ihe academic 
weakness, ii anv, that a student may liave. It is important to determiiu- an. 
o^s;uU\s that nrt-vent i\\v m udt-nt trom boin.v; successful. Suggestion^ 

atc -nade to the sCu^'ent on liow lie can «^orroct his educational weaknessts.^ 

tovinselnu; is an important part ol the overall program.. In the ivo or 
tiiree weeks btuden.!. is in our program, he will bu seen several times by 
either our counselor or the psychologist. During the Interviews the counselors 
try to help resolve any personal problems that niay prevent successful employment 
md to interpret evaluation information. In the final interview, the counselor 
makes recommendations and helps the student lay plans for the future. 

Ihe ('enter has a staff of 12.: There are four work evaluators, one educa- 
tional evaluator, a counselor, a psychologist, an occupational consultant, a 

secretary, a supervisor and two JEVS evaluators. The work evaluators are 
♦ 

l^eonle experienced in the trades that they are evaluating in and may or may not 
have anv college training. Hie supervisor, counselor and psychologist are the 
only positions requir^.ng a degree. One JEVS evaluator has a B.S.. in Industrial 
Psychology and the .other is a few hours short of a degree. However, it is not at 
all necessary tor the .JCVS evaluator to be a degreed person. Qualifications such 
as intelligence, alertness, sensitivity to people, the ability to develop rapport 
and the sincere dvh le to v-;ork with and assi'si people ,are much more important 
than a degree. 

lie po:)iila'L i un ^ eryed bv our Center comes Lr m a wide variety of sources^.; 
\:e receive student:s fron \'oc. Uehah.,,. ^TD'A, Stat:e Kmployment Office, community, 
correction nrograms and public schools-any institution or agency working with 
t'iie- d Isadvan t; iged and h md ica[>ped 

U'no art the disadvantaged and the hand i capj;ed? It seeniii theie is alv/ays some 
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coniusioti -ihoui who they are. They are viewed from a different frame of 
reterence as different people. So that we are all thinking about the same 
people, let me give you some of the causes of disadvantagement and handicapped 
that are listed in guidelines put out by our Special Needs Section of the 
Iowa Department of Public Instruction. 



Causes ot Disadvantaged 
Poor educatioaal background 
Home does not provide motivational or 

educational stimulation 
Lives in poverty 

Family is dependent on public assistance 
Member of a migrant family 
Undesirable home and/or community 
environment 



Causes of Handicapped 
Mentally retarded 
Learning disabled 
Seriously emotionally disturbed 
Crippled > ' 

Visually handicapped 
Hearing Impaired 
Other health impairments 



rhe Career Exploration Center is located in the Industrial Manufacturing 
Building on the Ankeny Campus, Besides the CEC, this building also houses tool 
and die, welding and air conditioning training programs. The setting is definitely 
an industrial one and not too much different than what is recommended for a JEVS 
operation. The room JEVS is located in what was designed to be a drafting room 
and has a tiie floor and a suspended ceiling with flourescent lighting. 

Our students do not spend all day In the JEVS component as they may in 
another JLVS ope"*ations. Our students are scheduled into three different areas 
each day. Ihey spend two or two and one-half hours in each area. Example: a 
student may spend two hours in graphic arts work exploration, two hours in business 
occupation exploration and two and one-half hours in JEVS during one day. Each 
d,i\ ihe sched'ile clian^»,cs,. 1 suaUy it Lakes between 12 and 24 hours to complete 



JKVS depending on the ability level of the student. 

We use JEVS primarily to gain personality information, dexterity and 
combination information and to determine the occupational grouping where 
success is likely. Since our program tries to stay away from standardized 
testing as much as possible, our psychologist likes and depends on the person- 
ality information gained from JEVS. In some ways it is more valuable and usable 
than personality information gained from paper and pencil tests. 

We have modified JEVS in basically only two ways. We do not give all of 
the work samples and normally only use 20 of them. The other variations from 
JEVS procedures is chat we have only two evaluators and no JEVS supervisor. 
Our evaluators do the work of both the evaluator and supervisor. They give the 
feedback interview and write the report for our counselors. Each evaluator 
has from 5 to 7 students to observe at a time. Otherwise, we follow JEVS 
guidelines and procedures. 

The JEVS program was shortened for two reasons. One was because we needed 
to shorten the overall amount of time in our program. The other was because 
some of the JEVS ta6k$ were duplicated in our work exploration areas. We first 
took a close look at the necessity of all of the work samples because of our 
need to shorten it.. Below is a list of the work samples dropped and the rational 
behind why that particular sample was selected. 



Work Sample 



Reason 



Rubber stamping 



Simple, monotonous and drew complaints from 



the i^tudents 



Budget Assembly 



'ime consuming and difficult for the evalu- 



ator to score. Info gained from this 



one can be gotten from others. 
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lile boning Ver\ simple task, students thought ridiculous 

Metal Square Fabrication Duplicated in Industrial-Mechanical work 

exploration area 

Hardv7are Assembly Very similar to nuts &. bolts, bothersome 

to disassemble 

Typing More fitting to our business exploration 

area (since dropped by JEVS also) 

Blouse 6i Vest Making Expensive, time consuming and employment 

not available in our locality 

We have not destroyed the work samples dropped and still have them. They 
are used on occasion when they are more appropriate for an individual. Most of 
the ones we dropped are simple tasks. They sometimes are used for the person 
with limited abilities. 

JCVS has some definite strengths. ilie primary one is that it is an objective 
evaluation tool.^ We in the work evaluation business need to do more to make our 
work sampling process more objective. it is all to easy to use terms such as 
"I feel", "it seems", "it would appear", and other indefinite terms in referring 
to a person's capability in performing a particular task or job. JEVS was 
particularly useful to as as a new evaluation program. T t is standardized and 
has norms. It gives definite data about what tasks a student can or cannot do. 

Another strong point is that JEVS will iuuicatc a grouping of occupation 
v;here the student v;ouId bo able succeed. his information is made more 
useful throujsh correlatin'4 i^ \o ihc Diciionar' of Occupational iitleso 

Anothc^r plus for h.'^'S, as I ha^o' already nenuoned, is its useful personality 
information . 

I.ikt ar^., y b':ir' ' 'm^ I's Vv-Lakpesses-, iiave tonnd thai it is difficult 

for the students r_u relate the individiial work samples to any real work situation. 




It is important to give a good orientation and explanation of why and how it 
works . 

Another drawback is the time involved in disassembly of the work samples., 
i-he work samples, of course, must be taken apart before they can be used again.. 
Our evaluators do this themselves. Not only do they not like to do it, but it 
distracts them from their observation duties. 

Our evaluators are very critical of having to lower a person's rating 
because of giving additional help. They have stated it is difficult to foUo^v 
this guideline to the letter. I was happy to hear Dr. Kulman say some changes 
have been made in this procedure. 

The Career Exploration Center has encountered no real difficulties in using 
Che JEVS system. We feel it is a very valuable and useful component of our 
total program. 



Pennis Krehbiel 
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The Tower System 

Bernard Rosenberg, Director 
Vocational & Industrial Rehabilitation 
Institute for the Crippled and Disabled 
340 East 24th Street 
New York, New York 10010 

HOW DOES TOWER WORK? 

The TOWER System of vocational evaluation uses the work sample approach 
to determine the job potential of handicapped persons. 

Currently, TOWER employs 94 work sample tasks, patterned after actual 
jobs in business and industry, which represent 14 broad occupational areas. 

Qualitative and quantitative standards are based upon performance of 
non-handicapped workers. TOWER' s usefulness as a predictive technique is 
implemented by criteria, scoring aids and records. 

Pioneered and developed by the Institute for the Crippled and Disabled 
in 1937, the TOWER vocational evaluation technique is used by rehabilitation 
agencies and institutions throughout the United States and by organizations 
serving the hand -capped in other countries. 

TOWER TECHNIQUES 

Studies of clients who completed the four to five week evaluation 
program at ICD indicate a significant correlation between TOWER ratings, 
trade training scores and ultimate job placement. 

tower's flexible and adaptable approach is used to assess disabled 
and socially handicapped persons, ranging from critical to routine, on many 
occupational levels. It is a reliable, accurate method for determining the 
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vocational capabilities of severely disabled persons and those who, because 
of cultural or other limitations, cannot be precisely tested with the other 
techniques* 

Conducted in a simulated environment that would be found in industry, 
tower's work sample approach is designed to reveal the totality of personal 
traits, including interest, work tolerance, work habits and attitudes as 
they relate to the work experience, as well as specific vocational aptitudes 
and skills. 

The manufacture of useful products in TOWER, such as brooches in jewelry 
manufacturing and picture frames in leathergoods , has proven a major factor 
in stimulating client interest, motivation and involvement, which are essential 
to the attainment of rehabilitation goals. 

By exposing the disabled client to mock-ups of the actual work situation 
and the myriad of demands implicit in it, the TOWER System enables the client 
to test his own ability to adjust to the work experience. 

Concurrently, it provides a laboratory in which the team of rehabilitation 
specialists in non-vocational as well as vocational disciplines can confirm 
previous diagnoses, set realisuic < Uent goals and gain new and valid insight 
into client progress. 

COMPONENTS OF THE TOWER SYSTEM 

The TOWER System is organized in.to four components: 

(1) The TOWER Textbook 

(2) The Evaluator's Manual 

(3) One-drawer file case containing all printed material required 
for operating a TOWER evaluation program 

(4) A 30-minute full color and sound film, "The TOWER Evaluators", 
which is used for orientation of professional persons and 
clients, and for development of sources of referral to TOWER 
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THE TOWER TEXTBOOK 

The TOWER textbook delineates the theory, development, purpose and 

application of the TOWER System against a broad background of contemporary 

trends in vocational evaluation. 

The 1967 edition, issued as part of ICD's Golden Anniversary celebration, 
has been reorganized, rewritten and amplified to reflect the evolution of 
the work sample technique during the past decade. 

The textbook establishes guidelines for those who have adapted or are 
contemplating adaptation of the TOWER System to the needs of :heir own 
institutions and agencies. It also serves as a text for students in many 
rehabilitation disciplines and as a valuable source book for professional and 
administrative personnel. It may be purchased by anyone at $7.00 per copy. 

THE EVALUATOR'S MANUAL 

The Evaluator's Manual is a comprehensive looseleaf book for the evaluator's 
use. It comprises 425 printed pages, including copies of all TCWER evaluations, 
reponse sheets and criteria, together with plastic scoring aids, general 
orientation data and detailed descriptions of the employment possibilities 
related to each category of testing. 

FILE CASE OF TOWER SYSTEM EVALUATION MATERIALS 

The third component — the one-drawer file cabinet — contains TOWER evaluations 
and printed response sheets for client use, and report forms for the 
evaluator's use in analyziu^i and reporting client performance. 

Space is provided for the maintenance of records and examples of past 
client performance.: 
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The iwOr.'ploLo^ ,sct of printed materials is priced at $325 plus postage 
and is available only to those completing the TOWER Evaluator's course at 
ICD. Persons taking this course under the auspices of the Rehabilitation 
wServices Administration receive a set of these materials in conjunction 
with their training. 

F1LM--"THE TOWER EVALUATORS" 

This full color and sound, 16-millimeter film depicts the vocational 
evaluator of three major types of disability. 

NEIV AND REVISED TOWER SYSTEM EVALUATION CATEGORIES 

CLERICAL 

1. Business Arithmetic 

2. Filing 

3. Typing 

3 a. One-hand Typing (Alternate) 

4. Payroll Computation 
5* Use of Sales Book 
6., Record Keeping 

7. Correct Use of English 

DRAFTINX; 

1. T Square, Triangle 

2. Compass 

3. Working Drawing 

4. Drawing to Scale 

5. Geometric Shapes 

DRAWING 

1. Perspective 

2.. Forms, Shapes and Objects 

3. Shading, Tone and Texture 

4. Color 

5. Free Hand Sketching 

ELECTRONICS ASSEMBLY 

1. Color Perception and Sorting 

2. Running a 10 Wire Cable 

3. Inspecting a 10 Wire Cable 

4. Lacing a Cable 

5. Soldering Wires 
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JbiWKLRY MANUFACTURING 

1 . Use of Saw 

2. Use of Needle Files 

3. Electric Drill Press 

4. Piercing and Filing Metals 

5. Use of Pliers 

6. Use of Torch in Soldering 

7. Making Earrings and Brooch Pin 

LCATHERGOOD S 

1. Use of Ruler 

2. Use of Knife 

3. Use of Dividers 

4. Use of Paste a:id Brush 

5. Use of Scissors and Bone. Folder in Pasting 

6. Constructing Picture Frame 

7. Production Task 

LETTERING 

1. Lettering Aptitude 

2. Alphabet and Use of T Square 

3. Use of Pen and Ink 

4. Use of Lettering Brush 

5. Brush Lettering 

MACHINE SHOP 

1. Reading and Transcribing Measurements 

2. Blueprint Reading 

3. Measuring With a Rule 

4. Drawing to Measurement 

5. MetaL Layout and Use of Basic Tools 

6. Drill Press Operation 

7. Fractions and Decimals 

^. Measuring With the Micrometer Caliper 
9. Mechanical Understanding 

MAIL CLERK 

1. Opening Mail 

2. Date-Stamping Mail 

3. Sorting Mail 

4. Delivering Mail 

5. Collecting Mail 

6. Folding and Inserting 

7. Sealing Mail 

8. Mail Classification 

9. Use of Scale 

10. Postage Calculation 

OPTICAL MECHANICS 

1. Use of Metric Ruler 

2. Use of Calipers 

3. Lens Recognition 

4. Lens Centering and Marking 

5. Use of Lens Protractor 

6. Hand Beveling and Edging 
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PAATlKiia t't! K\(: RAWING 

1. IntrodiK tion to the Kngravograph (Pantograph) Machine and Determin- 
ation of Aptitudes for Setting Pantograph Arm Ratios 

2. Setting; Up, Centering Copy and Determining Specified Ratios 
1. Use of Workholder and Adjustment of Cutter 

Setting Up and Running Off a Simple Job 

SEWING MACHINE OPERATING 

1. Sewing Machine Control 

2. Use of Knee Lift and Needle Pivoting 

3. Tacking and Sewing Curved Lines 

4. Upper Threading 

5. Winding and Inserting Bobbin 

0. Sewing and Cutting 
7. Top Stitching 

WELDING 

1 . Measuring 

2. Making a Working Drawing 
1. Identifying Welding Rods 

4. Use of Acetylene Torch 

5. Use of Rods and Electrodes 

6. Use of Torch and Rod 

7. Measuring and Cutting Metai 

8. Soldering 

WORKSHOP ASSEMBLY 

1. Counting 

2. Number and Color Collation 

3. Folding and Banding 

4. Weighing and Sorting 

5. Counting and Packing 

6. Washer Assembly 

7. Inserting, Lacing and Typing 
0. Art Paper Banding 

TOWER EVALUATOR'S INSTRUCTION 

A three week training course for TOWER evaluators, conducted by experienced 
ICD ^'ocationai evaluation personnel, provides thorough orientation and enables 
trainees to gain practical as well as theoretical experience in administration 
and evaluation procedures. 

It also teaches trainees how to establish an evaluation unit using the 
TOWER fnethodol(^^y. 

Likewise, it functions as an overview of the operations of a multi- 
dihLipIinary, iprehc'ns i ve rehabilitation center in which TOWER evaluation 
is an integral part. 




78 



To be eligible for TOWER training, a person must have a specific 
assignment with an established agency or facility to conduct a vocational 
evaluation program. 

Grants and stipends provided by the Rehabilitation Services Administration, 
United States Department of He Hh, Education, and Welfare, cover living 
expenses and specified costs of the course, except for tuition. These 
benefits are available to citizens of the United States. The three week | 
course tuition fee is $200 for U.S. Citizens. Fees and charges for citizens 
of other countries are available on request. 

A complete set of TOWER System materials (textbook and evalu tor's 
manual) is furnished to the agency, facility or institution represented by 
an accepted trainee upon his or her completion of the course. Others may.^^ 
purchase the complete set of TOWER materials after completing the, course. 

The TOWER System is a copyright developT.cnt of the Institute for the 

Crippled and Disabled. For further informatioi or purchase, write to: ( 

• 

The TOWER System 

Institute for the Crippled and Disabled 

340 East 24th Street 

New York, New York 10010 
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THE' WIDE RANGE EMPLO\'MENT SAMPLE TEST 

Guidance Associates of Delaware, Inc. 

152b Gilpin Avenue , 
Wilmingto'-i, Delaware 19806 

The Wide Range Employment Sample Test (WREST) was developed at 
Opportunitv Center Inc. (OCI) in Wilmington, Delaware. OCI is a workshop 
for the nentally and physically handicapped and serves as a training 
resource to develop basic work production skills. The work activities 
at OCI were the bad's of development for the work samples included in 
the WREST. The work samples are referred to as the Jastak-King Work 
Sa:nples. Mrs. Dorothy E. King developed the work samples and Dr. 
Joseph F. King standardized them. Standardised scores have been 
developed for both handicapped and nonhandicapped population groups. 

The WREST was originally developed to evaluate the (through 
observation) production of work relative to economy of time and movement. 

Production time and error norms were established for the OCI 
workshop population (300) and for persons actually employed in regular 
production shops, industry, commerce, and service (100), The Industrial 
norms have been described as being helpful in estimating the readiness 
of a client tc^ enter reg'jlar employment after completing a work 
adjustTient .md training progran-. 

Ten vork samples cc^mprise the WREST. They represent manual and 
clerical job situatii^ns found in commerce, industry, and service, 
r.ach san[;le is or'^an5/e'' to obtain a 7-15 minute sample of a work task. 



'latfrial'. re,>restMU i ng the samples are compactly stored in a portable 
kit neasurinv; 13 x 15 x 15 inches. Work sample activities include foldiiu', 
sttplin>;. i>.Kk.ii;in>;, measuring, assembling, tag ctringing, pasting, 
v.'t>llatiiK;, Lolor and shade matching, and pattern matching. 

ihe specific work samples and what they entail are described below. 

Sample No. 1 - Folding 

This activity would relate mostly to secretarial - clerical - general 
v^ffice and statistical procedure. It entails the handling and folding of 
paper envelopes - glue - tags. Some degree of dexterity and orderliness 
is required. 

Sample No. 1 - Stapling 

Requires a degree of spatial judgment - ability to use mechanical 
devices and manual energy output related to industrial application such as 
spot welding, heat sealing, carton manufacture, book binding, press operatio 
(drill and printing^ stamping, sewing, general small machine operation, 
requires some degree of accurate control. 

^a^[lle \'o. 3 - Bottles and Pegs 

Requires dexterity, color recognition, coordination, application to 
ivhistry would be in snail parts packaging and order filling in automotive, 
eleLti\mics, nachine parts, toys, large variety of any type of small items. 

Sar^nle \o. U - Rice Measuring 

Lntails the filling of vials in varying measurements with fine material 
requires good jodgment of quantities and some degree of speed of estimation. 

U7 



Iiulustr> appl .cat ion; drug (wholesale) industry, food, paint, cosmetics, 
etc., where specific measurements are required. 

Sample No. 5 - Screws 

Requires the ability to follow d prescribed pattern or sequence using 
various kinds of nuts, bolts, and washers. Requires the ability to recognize 
pattern and pattern construction, good dexterity, mechanical aptitude. 
Industry application: wide range of mechanical and semi-mechanical 
fastening of related parts, readily adaptable to solid state electronic 
circuitry, placing of diodes, resistors, transistors, etc., on a circuit board 
and fastening with either screws, solder, etc. 

Sample Xo. 6 - Tags 

The ability to work with two different types of materials - semi- flexible 
(tags) and very flexible (lacing) - requires some degree of finger dexterity 
and judgment (keeping ends even). Applications aie quite naturally garment 
industry, textile-parts identification, any type of application requiring 
identity and dexterity. 

Sample !.'o. 7 - Swatch Pasting 

Requires neatness, good judgment with space relation, some degree of 
artistic appreci tion, reasonable amount of dexterity. Application to industry 
would be creation of sales samples, crafts, display, advertising paste-up, 

crtistic^ arrangement. 

Simple ij. S - (Dilating 

F.nt.iils the 'o:nniling of different colors (color recognition) in a 
prescribed sequency or order (patterns) and filing in a prescribed manner 
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(neatness ami order). Applicable to office procedures, inventory control, 
order pa».kin^, 

^Sample No. 9 - Colors 

Ability to differentiate colors, hues, shades, placement jucigment, 
arrangement. Again applicable to preparation of sales material for yard 
i;oods, paints, advertising, craft work, displays. 



Sample No. 10 - Pattern Matching 

The ability to differentiate colors, analyze arrangements, structure 

placement and composition, adaptable to arts, construction of complex nodels . 

I 

pattern making, architecture, marine-aircraft cons tructjion, electronic 
circuitr\, atui the like. 

The WREST was developed for use with individuals beL aen the ages oi lo 
and 35 and can be administered individually or in small groups (3 to 6 persons), 
It takes approximately 1'^ hours for individual admin? -tra^ion and 2 hours for 
group adninistration. The test may be readminis tered at regular intervals 
to derive a learning curve which distinguishes between learning rates of 
those who .are rnentally retarded and those .w .,. may test retarded initially 
but are not. 'Ihe test should be administrated and interpreted by trained 
^valuators, psychologists, and personnel and employment specialists. 
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\ .Ma^uil avirlable on Liie .vKi.hr which mil Uules she^ific rlirevtlori- 
t.T i'M'scoriiu; iho lest. .\"or"io and Measures of ^ariabilltv tor Liu ten 

I i ^.ks i rt* I 1 c t ' 1 K 1 LUletl . 

s^oriiu; the vvREST can be done by haud. '1 i >>e aad errors arc ciMisidered 
I' tiu' >vOri."v''., 'Ihf results are e\pressed i.i staiuae scores for e,.u h 
jiiale^t «U'^. [he tea scores are added to obtain a total tox'-ww^ ^ ^c-re 
ti>r eav^h '.'ersoii. 

Ihe a-chors of the WREST elain that the WREST can be used for the 

I o i 1 ; I rt . : 

I M i • -t'joi/ the iadustriai etficiency of a person in terns of cime .mu 

I ^ T'^ i-'a.e.k in .i .-^ c ap..:a ra i ::e:i "^anrser an individual's approach to i 
^- J i 1 1 1 1 " o o > e t - 1 : : ' < 

i> observe itcltudes, eff'^rt, r-roduction rate, and a nunber of^ 
e otio-^tl. iiti' iiio^Ai ap.d social variables iieeded for success ou the -ob. 
t i> t,v^:-^bel 'N^Ith a wide variety of individuals--the disadvar Laired . 
:.';-t-d^, :he -^'eit.illv Talad Misted, and retarded., 
' tTii^, disiMed :)erso-^s \\\ the specific ?<ills fon-^d Iac;^^l'^ f'^r 
e: f u c -t r>'-\L u ' 

' • - ' r.n.'-c' tro^ > ^ id-i-ite .\s<o. lite.^ t-f '-oLivire^, i 
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COSTS COM , 

'.vork Sanple Kit and 2 5 Record Forms - $395.00 
Work Station Cabinet - $250.00 (optional) 

Re ferences 

Jastak, J. F. , and Jastak, S. R. Guidance Associates of Delaware, Inc . 

Ivilmiagcon, Delaware, 1972. 

Jastak, J. F. and Jastak, S. R. The Jastak - King Work Sample s Manual . 
.vilnin^t:>n, Delaware: Guidance Associates of Delaware, Inc. 1972. 



Talent .\ssessmer>t Tests 

>vilton E.: ar ! Maurine K. \i'',hswonKer 
Talent Assessirent Programs 
7015 Colby Avenue 
Des Moines, Iowa 50311 

I ntrouui. t ion 

A testing progratn designed to be utilized on people of all intelligence 
levels a.Kl all levels of capabilities must, of necessity,, be action orient.>d. 
Paper testing of those who read slowly and with difficulty does not provide 
a true (Treasure of the people being tested. To appecr comoletely usable as 
a-^. i.'.stru-ent desi.^ned to reflect the inherent characteristics of an individual, 
v.-hich u-e aupl-L-able to work, a cor-posite test battery should reflect several 
capabilities. It should be capable of accurate -measure T,ent of the attributes 
I person has at th- ^i^.e of his first appearance. This serve? as a ref- 
erence point fron whi. h all chan^^e in an individual can be neasurpd. The 
v-haracteristics -US': be measured with enough definition and accuracy hat 
the rchuits .ai he deveioped into norn tables and be related to industrial 
sta-.iaDis. The entire operation -nist be a^cur^te enough to percnt realistic 
proiecti'Ti i ~(i pri\i:ra"^ Jeveloprei't: . 

;he ls^i ,ss-ept natterv to be dese ribed is cc.iposed of eleven action 
tests det;i^-ed to -eisure tne -harat teri s t ics applicable to work in indus- 
trial or tech.-.i.al li-es.- Thosu X.cin. Tests are designed to hold the 
■"Pil in . . sitive fra'ie of mind a;v! serve as guidelines for interest ar.-: 
.iDicit/ e ..,'li. ration in career educatio,-,... The tests will probably 
irpeir ■f-- different to nost p-iuil personnel 'arvi.es people because 



they have not been commonly used in school sett'ngs. They are functional 

level tests of career-related aptitudes* The list of titles would include 

visualizing structural detail, discrimination of objects by size, shape, 
♦ 

color, and touch, dexterity, electrical flow diagrams, and memory for 
structural detail. 

During the course of testing, many subjective observations can be noted 
and recorded for the benefit of instructors, counselors, and coordlnat6¥s» 
Some of the items to be observed are: 



Appearance 
Mode cf relating 
Personal organization 
Emotional control 
Work approach 



Communication 
Objective recognition 
Realistic level 
Punctuality 



Other items that may be observed are: voiced aspirations or goals 
related to work, the amount and. type of supervision required during the 
testing effort, how the client was handled, changes noted during the testing, 
and why some tests were not attempted. The tests will give some indication 
of the probable level of operation by demonstrating physical limitations 
and threshold tolerance. 

initial assessment should require only about two hours* it will serve 
as a reference base from which change and development can be measured 
during periods of exploration and work try-out. Combined with psychological, 
academic, and medical test results, it gives a very real picture of an 
i nd i vidudl . 
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It is seldom necessary to give all the tests to each person. Practiced 
relators* leara to quickly select nests that appear most appropriate for 
4 pupil, in the light of his ak»e, educatioi, experience, physical limita- 
tions, mental limitations, and apparent realistic desires. 

The '*A'* profile sheet illustrates a working form that can be utilized 
for recording pertinent information related to the person being tested 
and the results from various assessments being applied. Using norm scales 
to graph the assessment results gives a profile quickly meaningful to 
relators, counselors, and industrial personnel managers. In contrast to 
reading lengthy and detailed test results, this profile sheet gives, in 
one glance, a complete picture of an individual's strengths and weaknes^ses 
as they might be applied to any number of work situations. 

Psychometric testing of academic capabilities. an3' academic achievement 
is very fine for pupils whose career objectives niay be higher education 
and the professions. For pupils planning to enter the service occupations 
or trade training, particularly low level trade training, it is a very 
inappropriate and inadequate approach. Nobody denies that to be 
acadenically strong is good in any situation. However, being academically 
strong is not a prerequisite to successful exercising of the many other 
inborn attributes applicable to work. To assume that academic weakness 
1 -plies weakness in the physical attributes of dexterity, discrimination, 
visualization, and retention is fallacy. Many times people who are 
considered retarded when measured by conventional and rather singular 
instruments can demonstrate unusual strengths in functional characteristics 
if given a chance with proper tests and materials. 
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Cfr^ Employee Handbook > Contains policies, procedures, job descriptions^ 
^ it^ *%w-to«do-your-job" guidelines, so that a student can function with 

a stuifliw of formal instruction. In the PRC^file section of the handbook, 

'■»■.# ■ k 

U^^^fA^tB are invited to retain representative samples of their work to fore 

, ' i ' [ ' 

*i ji . 'y^ 1 1 ^ • ^ t 

a mi credentials, which can be shown to potential espldyers after 

■ Bteetlns^ Units. There are 30 units, each consistli^ of from 

: eiight visuals and eomeiecitaries , which students use to conduct business 

r^:^^^p^^ They call for the presentation and discussion of specific policiei^i ' 

* i , - ' I - - 

s, and other business related subjects. In addition they realisiiiftll^ 
^!'~^m€UHBtudents in pre^ring for a meting, oakitig an agenda, reserving a j 
\'m^^i^ room, conducting a seeting, etc. 
/ ' J (8) ^felll Input Envelopes. Each week a mil input envelope provides the 
tniMing (sail. These envelopes, 36 in all, contain a total of more than 
1,5% letters. These letters pjrovlde the key to' a great deal of related 
activities. To answer them they require research, give opportunities for 
transcribing dictation notes and deniand retrieval and filing. Together with 
Me correspondence in the special projects book, they, will require some 4,000 
plus letters in answer. 

■ \. ' - • 

.\The material in the APEX program will supply some 540 classroom hours 
each i>f practical work for 20 students. They are sufficient for 20 
studeats working three hours a day, five days a week for 36 weeks. The 
mater ii^ls can be adapted to accommodate. smaller or larger groups wdrking 
fewer or more hours for a longer or shorter period of time. 

■ \ ^. . / 
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^ ' f I I 4 ,%6^t8 of DiscriHrination of objects by size, shape, color and touch, 
' 8^yi9n below: 




.|^^^^^b¥oyld relate to: 
'i0^^^^^tohic Astsembly 
' 'ga^vHiWIistry 
ur-^ ,^ . Bittdware Packaging 



5 & 6 

, ' 'J . < I 




Art 
Watchtaaking 
Flowev Arianging 
Drafting 

DEXTERITY - NO TOOLS 



Osteopathy 
Body and Fender 
Decorating 
Health Related 



^ ! , t% is interesting to note that many people who appear entirely 
iiMi^ble when attempting to work with tools, appear surprisingly capable 
^eft given the opportunity to demonstrate dexterity in handling raw 
p&^efials without tools. 
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Relate these to such as; 
Faitory Assembly 
Mall Sorting 
Ceramics 
Bookbinding 

TEST 7 



Electronic Component Layout 
Partsman 
Hardware Packaging 



FINE DEXTERITY TEST 



The Talent Assessment Programs Small Tools Test utilizes^one hand and 

I 

two had operations. o 
The results from this test are quite meaningful to those who might be' 

interested 'In such things as: ^ 



Data Processing 
Office Machine Repair 
Sewing (hand) 
Negative Retouchl 
Watchmaking 
Surgery 
Electronics Assembly 
Photo Coloring 



Laboratory Technician 
Electronics Service 
Jewelry Making 
Dentistry , 
Drntal Technician 
Instrument Technician 
Appliance Servlie 
Factory Bench 



It requires about fifteen minutes for preparation and administration. 
The development of local norms is Imperative. 
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fEST 8 



DEXTERITY WITH LARGER TOOLS 



The Large Hand Tools Dexterity Test Is utilized to determine a pupils 
capacity to handle medium or large size tools. The results are immediately 
meaningful to people who are entertaining Interest in any of the numerous 
fields of mechanics. Use of this test requires about five minutes of 
preparation and ten minutes of actual testing. It may be used on both 
men and women where workshop activities and/or factory production types 
of work are anticipated. The production of local norms is Imperative. 
This test is related to work in 



Au€cHiK)tive Mechanics 
&>dy and Fender 
Cabinet Making 
Upholstering 
Small Engine Service 




Major Appliance Service 
Small Appliance Service 
Farm Equipment Assembly 
Office Machine Repair 
Welding 



TEST 9 



CIRCUITAL VISUALIZATION 



In this age when electricity and electronics play an ever-increasing 
role, it is quite Important that we measure capacities for circuital 
visualization. This can be accomplished with a test such as that which 
follows. 

Norms for this test can be established after about 100 people have 
taken it. 

Although not commonly attempted, it is possible to measure a person's 
capacity to retain detail related to circuitry. 
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fbis tast should be atoinlstered oQly ^to those people iiho express a 
ieiite to Irarn of their strengths and/or weaknesses in circuiul 
visualisation* 




liki^^te these to such as: 

fleetric Wiring Power Transmission Telephone Service 

Appliance Service Auto Electrical Drafting 

Factory Assembly Electronics fj^^ 



« , TEST 10 RETENTION OF STKUCTURAL AND MKBANICAL DE1AIL 




The retention of detail is quite important to a successful worker. 
Approximately two hours following the measurssent of visualise tion» the 
saaae procedure should be exer<|ised except the oiodel or pattern is not ^present 

When norms are being developed on this test» remember it is imperative 
that this time-lapse between the giving of the visualisation teits and this 
one be relatively constant. An approximate two hour lapse works well. 

103 



li sTRiiciuRAi. AMD i«:MyiiauL visiiu.iain(M m ctEftm tmra 

ti k person It of relatively high intollitMC* apfMrs 
itec^CCaiailly strong on the^i^«)e test of Mchsaie*! mtd atrQcteral 
VtMi^limtion, iltould b* givoa «a opportttolty to atte^^t ^ aore 

iiif Aiyt« VtSISU^IZATIOH TEST. 



- 1 , 




iMm test should be offored only to people who iri,ght be potential 



engineer's helpers, or drafts«M. 




.^^Jl^is to Such as: 

t^M*^**^'*"* Bttllty j^gi^teenag iavifeenental' Control 

fypWag Engineering Strmstenl I^neeri^ RaateiMKe Weg, 

1 1 DIRECTIOHS FOR TEStlMS 

; ; ^ \ 

1 I ^1 mt^^:^^ _^ -» « ^ 4' -* - - 

fldnUlMr^ on sturdy tmbl^, &ot 0ccypl#d £^ ^rt o^t cliMU* 

\ '-^ I 

I ' te Hftke cwtain that cllMts tav« eom^l^t* mterstaaiiat of tm^t 

dlfileti^, even If it it M^MMry to JM^^* d«wfi»tnt#« qimti^n 



1^ lists of dsxtsrity, discriidnsti^ii,! and SMSorii^ rtduld sd* 



I 

3i Without exception the dinctions aust slmys be the seoie. To 



insure Ais, they should b^ reed from tte Woric Sheet. 

4e denerally speakii^, it is not necessary to give tkm tests in the 

I 

order of listing. Excoptions to this are #'s 1, 10, & 11. 

tests #7 and #& should be given on tables entirely apart froa the 
other tests. 
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tMtt #3 «iid #7 •heuld b« JLn mtwm IM^t •quivaltnt to tkmt wkich it 
ftlttrftMriKd i^^oate for art work or drtftii^« terwil^raftdjU^ ll^t is 

- 'I 

m^^im^t for «11 o^r ceiU. < ^ 

iin^c this U group CMtti^., the aurfcii^ aad flni^i^ tiMs dMuM il# 

^ ^^^^^^ ilfott « coQtlmiouo timt itMir roodo ia to^rte of a ,li»r 

of oomdiig iMd ptofilii^» orro» aro eoo^mrtod ioto iMttiimat 

.\ * / ■ ^ ^ 

Tlw colts aro giimi ataoiard iioiA*liffit €^ltl^i« 

^. > ' \ , ■ 




SKI iSiMMBm 




lly iflAWn oily rat* -TM* wiU iMMro Mi»»i^ W MiA»ni acti^. 



/ 



\ 



\ 



\ 
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ASSHSSMKAT OF ORlGlNAi CflARACTKR [STiCS 
'^A" PROF 1 1 E 



Name 



±_\)d t e January 29, 1^^3 



Aue I? Grade level Completed _12_SLhooI /Orsani..itton Central Catholic \\ix\h 

Crane! Island , Nebraska 

Work Experience^ 



Tester 



I, Visualir:ing Structural Detail 

2t Sorting - Size &. Shape 

i* Sorting - Color 

^•4. Sor'ting by Touch 

5. Handling Small Materials 

6. Handling Large Materials 

7. Using Small Tools 
' • Using Large Tools 

9. Electrical Flow Diagram 

10. Memory for Structural Detail 

11. Coaiplex Structural Detail 



NORM SCALE 
0 10 20 30 40 30 60 70 30 90 ^100 
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NOTES 

With 7 of the 10 assessments near or to the left of center, Kay may feel 
a desire to seek training and employment in general work areas- rather than 
in industrial or technical lines. She does use regular or larger tools and 
handles materials well enough to work at about the semi-skilled level on an 
industrial assembly line if she desired. She might i ike to review the TAP 
papers that r 'ite the individual tests to specific jobs and read about those 
job possibilities in the Occupational Outlook Handbook. If she desires 
'general work areas she should review the U.S. Office of Education Cluster 
outline and possibly be surprised to find that there may be more career 
opportunities in the general areas than in specific lines. These are also 
described in the Handbook. 

T.Q. ("Talent Quotient) 103 

lUb. 



Name 



■ • . PROFILE 
Educable M 



.Da t e February I, 1973 



Age 12 Grade Level Conpleted_6_School/Qrgani2atioa Connell School for the 

Retarded, Grand Island, 
Work £xperience_ Nebraska 



Tester 



NORM SCALE 
0 10 20 30 UO 50 60 70 80 90 100 



1* l^isualizing Structural Detail 

2* Sorting - Size & Shape 

3. Sorting - Color 

4. Sorting by Touch 

3* Handling Snail Materials 
b^Handlint; Lar^:^e Materials 

7. Using S(Tial1 Tools 
B. Using I jrgG Tools 

9. Electrical Flow Diagran^ 

10, Memory for Structural Detail 

11. Complex Structural Detail 




:<OTES t 



Mentally Retarded N\^rnis 



/ 



Senior \U^h Males 

Clifford visualizes lechaiural asstr^blies better than fnost of his classmates, 
but experiences s^pe difficulty in re^e^iberi ng detiil related to such 
assemblies • All the other assessment results would seen able to support 
him ia interest exploration activities and training that would lead to 
emrloynent at the se^u-skilled level,. With the exception of the capacity 
to visv.rxlize, it is ipterestint; to note the snuU clifferences between the 
f?rofile developed osi fiorr.s of his own group and that developed from the 
norms of 12th grade boys. In three or four^years he n)ight want to study 
the papers that relate the assessments to specific job titles and then 
seek occupational in forsnatio i from the various sources available to hin^* 
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The tent results are profiled in a manner that gives a ten-second 
Weadout ia the language of employment Personnel* As you study the 
enclosed profile sheets please bear in mind that these are all action 
test.q - no paper tests. People thoroughly enjoy taking theai. They 
are applicable to all ages above twelve and to all mental levels above 
trainables. Sorne of them can be used on trainables« It is not unusual 
to see special education people, who read at the second grade level, 
doing better than college graduates on test nine, VISUALIZATION 0? FLO^ 
PATHS IN ELECTRICITY. They then go on to take training and employment 
as electrician's helpers if their dexterities support it* 

Norms have been developed on seven different people classifications* 
TALENT ASSESSMENT PROGIl\HS nanufactures and sells the tests used in 
asses^inent of inherent characteristics or contracts to do the testing 
where schools, industries, and manpower programs are located reasonably 
close* 

The assessment kits come in four siees: 



'"'1 I to 5 people at one time $1500 

'^2 6 to 10 people at one time $1850 

•-3 11 to 15 people at one time $1950 

"4 16 to 20 people at one time $2100 



The cost Includes training up 
to four staff people in testing* 
Kits 1 6t 2 at Des Moines and 
3 €t 4 at your location. 
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T E i 


J T R E L A 


TED IN 


FORMATION 






SENIOR 


HIGH HALKS - 


3 sample 






NUMBER 




STANDARD 
DEVIATION 


COEFFICIENT 
OF VARIATION 


1 


331 


11.46 


1 OQ 




2 


330 








3 


311 


5.61 


2 


2S 77 


4 


328 


4.52 


1.96 


43.47p 


5. 


324 


10.25 


2.24 


21.91 


6 


30D 


5.49 


1.47 


26.8% 


7 


316 


7.84 


1.7 


21.7% 


o 


325 


8.16 


2.2 


24.5% 


9 


308 


4.01 


1.69 


42.0% 


10 


31o 


10.77 


- 3.27 


30.4% 



Content validity is insured by using materials and tools of the trades. 

The coefficient of sta^bility obtained by limited retesting at the 
junior high level is .88 with a six ftK>nth interval. 

Further standardization material is being developed under the direction 
of Dr» Richard Brooks - Drake University. 

i 

No two tests are designed to measure the same thing. / 
Discrimination risk is avoided through the use of oral directions. 
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hny person is comprised o£ two basic potential segments: 

FUNCTIONAL POTENTIALS ACADEMIC POTENTIALS 



Measured by T.Q. 

THE TALENT QUOTI^ relates 
to the functional capacities 
applicabl to THINGS and 
mTERIALS in the world of 
work. 



^ Measured by I.Q. ' 

Relates primarily to 
capacity to apply logic 
in solving problems in 
the field of intangibles. 
Foundation of the professions 



(*jective assessmnt of cmtive capacities is not to be confused with 
interest exploration and occupational information programs such as 

!i 

iinger^Graflex, JEVS, and others. The program are complimentary in 
thiat much time is saved in exploration when pupils are guided In 
interest exploration and work activities by knowledge of strengths and 
weakmsses as shown by the profile, ffcich frustration is avoided wheu 
peojple do not attempt the things for which they are not fitted. 



Wilton E. Nighswonger 
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APEX 

The Office: Reality Training Throu^ Simulation 

3M Comply - Visual Products Division 
3M Center, Bldg. 220-lOW 
St. Paul, Hinnesotag 55101 
^ (612) 733-70I1 

j^PEX represents tUe Ao^rican ^aper Exporters Association, a fictitioui 
i^t^si:^ion modeled after a real 01^ that serves tim Anerican Pap r Ii^ustry. 
tte diMipany serves as the o^jor ot^anization for an office eduasition progr^ 
^fite Office: Reality Trainii^ through Siioulation) i^ich allom t^ctiers to 
tiir& a classroom into an operating business office for reality training 
through simulation. Although the office simulation program was designed for / 
training* work attitudes as well as skills are emphasized. Consequently, 
the program is designed to reinforce preparation for work which deals with 
skills as well as work attitudes such as resourcefulness, pride, promptness, 
etc. The program was also designed to emphasize evaluation of performance. 
Evaluation is completed through observation ar^ written records. 

The major vehicle for the office simulation program is APDC. The 
ilistructor, as office manager, selects students for jobs in APEX after stud^ts 
formally apply and are interviewed* Ten entry level positions available 
for hiring are typist^ file clerk, atachine operator, regional clerk, 
copy clerk» design clerk, billinj^ clerk, payroll clerk, mail clerk, and 
receptionist. Promotions are made to three intermediate positions of 
n^chine specialist, general clerk, and conmiunlcations specialist and one top 



\ 
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p0Biti0h of clerk typist. The instructpr can create other positions to 
adeo^ibdate ability levels of students. 

Cotaponents which make up the total program are an office manager's 
guide, transition units, criti'cal incidents, clusters book, special projects, 

ffl^i^yee handbooks, staff meeting units, and mail input envelopes. ' Further 

\ 

fieseripfions of these compc^nents are as follows: 

$^ / ^i) Office Mai^Rer's G6ide . Gives the program rationale, 'the structure of 
Jinn, detailed guidelinjes for conducting the model office's business. 



^^pim the instructor* njeds to kndi# to get APEX functil^l is included. 
i^MIXw tgansitioa Vnlts* Making the transition f class^som to office 
,l#:||f^ifaisl»d with the telp of nine transition units, i^iich consist of 
I vt^^^ and text for the Instructor to explain APEX and its operation to 



I 

the students. 

■i •! 't 



(3J Critical Incidents Booklet . Every office woricer has persocuility 

. :J'. \ 

conflicts and suffers from interruptions, and disappointiKnts. There are 
50 lAcidents to be role*played during the course. They are carefully 
selectt^ to develop decision making skills on the part of the Students. 

(4) Masters Book . Every business needs letterheads, office forms, etc. 

J 

The liasters Book contains all of the forms used at APEX, which can be 
duplicated inexpensively for use by students. 

Ki> Special Proiecty Book . Several speciiil projects are provided in a 
separate booklet vrfiich the instructor can use at his\ discretion. They provide 
opportunities for practi^g sk/lls such as arrangin^^ for executive travel, 
hostir^ conventions, preparing speeches^ etc . 
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' (6^) Employee Handbook s Contains policies » procedures, job descriptions^ 
^ tfni *ti^*to-do-your-job" guidelines, so that a student can function with 
t dAMaiifi of formal instruction. , In the PRO<-file section of the handbook, 
^^i^MntB are invited to retain representative samples of their work to form 
i i«6 #f credentials, which can be sho^n to potential employers after 
on. 




, ri?' \ 'ift1^) Staff ?teeting Units > There are 30 units, each consisting of from 
'jtr^i^v^.^,^^^^^ visuals and cosMientaries , which students us^ to coi^uct business 



^^I^^^^^^'i^ They call for the presen^tion and discussion of specific policiei', ' 
ff^^^^^^s, and other business related subjects. In additibn they r^iisti^tlF 
' .;^^Ji]istudents in pre{^ring for a meeting, m^ing an agenda, reserving a , ^ 
room, conducting a meeting, etc. 



1 '|'s'= 

j t 0) Hail Input Envelopes* Each week a mail input envelope provides the 



i^^rtti^ mail. These envelopes, 36 in all, contain a total of more than 
t»9M letters. These letters provide the key to' a great deal of related 



acti^^ilties* To answer them they require research, give opportunities for - 

\ 

trarisctibing dictation notes and demand retrieval and filing. Together with 

I 

the correspondence in the special projects book, they, yill require some 4,000 

I ■ ' 

plus litters in answer. 

■ \ I 

\ The material in the APEX program will supply some 540 classroom hours 
ea^hVf practical work for 20 students. They are sufficient for 20 
students working three hours a day, five days a week for 36 weeks. The 
materials can be adapted to accommodate. smaller or larger groups working 
fewer o^ more hours for a longer or shorter period of time. ^ 
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i\;/aluation of student performance is provided for in a number of 
ways I , 

^ ^ (i) Each critical incident and special project offers the opportunity 
critique and evaluation^ ? 

(2) Each meeting unit has built into it an evaluation component* 

(3) The instructor by observfng the student's performance in the office 
^AS^revi^wing material he produced, can keep an up to date record of the 
ascocsplilsfiMnts of each individual. 

' CW^^ft important part of the program is the evaluation form which is 
,j^>||#^iif§wleted for each individual every four weeks and is vital as a 
^Ip^^^i^^te for advancement or promotion* ^ 

' '^yf 'A subtle continuous evaluation involving the students themselves is 

tfik' s^fuehtial structuring of certain tasks which for ^tifcess require each 

' ,' ' *i* ' # 

^^Ibfem ko satisfactorily accomplish his particular part of the job, and on 

' : \ 
tiaew 

i pan be purchased tibrough the 3M Coo^any* 

Visual Products Division 
3M Company 
Box 33100 

' St. Paul, Minnesota 55101 ^ 

i 

Cost 

Thfe Office: Reality training through simulation 
(fnsjtruc tor's guide, visuals and material for 

20 students) $1,195.00 

Office Manager's Guide (Orders should accompany 

{faster package orders) 49*95 

Employee Handbook 6.50 (Each) 

Student Replacement Supplies (20 Students) 195.00 
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The nuteriaL^ which require periodic replacement are: 

(a) Emploj^ee Handbook 

(b) Booklet of Critical Incidents 

(c) Input Envelopes 

(d) Special Projects Book 



Re ferences 

Visual Products Division - 3M Cospany. APEX, St. Paul, Minnesota, 
78-1772-6248-8 (926.3) MP. 

Wright, L. E., Santos, 0, J. Jennings, W. E, The Office ; Reality 
faillEAt^ Through Simulation - A Sampler , St. Paul, Minnesota, tiinnesota 
Kitting and Manufacturing Company, 1972. 
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Observations and Implications^ 

Dan Kroloff, Chief 
I Special Needs Section 

Department of Public Instruction 
Grimes State Office Building 
Des Moines y Iowa 50319 

This workshop was conducted in Council Bluffs, Iowa, on March 26 
and 2?, 1974, for the purpose of reviewing commercial vocational 
assessment systems* We wanted to know what they are and the value they 
may have in career education programs conducted in secondary public 
Sdiiddls, area vocational and coffmimnlty colleges, and correctional 
institutions. The following systems were reviewed? 

1. The Singer/Graflex Vocational Evaluation System 

2. the Jewish Employment and Vocational Service Work Samples 

3. The Tower System 

4. The Thomosat System 

5. The Wide Range Employment Sample Test 
6» The APEX 

7. Talent Assessment Programs 

In reviewing the information presented, it appears that a number of 
factors relating to the "systems** approach must be considered before 
purchasing and implementing. It should be pointed out that the workshop 
presenters represented various levels of relationship to the commercial 
assessti^nt systems. Comfnercial marketers were represented as well as those 
who administer the units from public secondary schools, area vocational 
schools, correctional institutions, and rehabilitation facilities. 
University staff who concentrate on the area of vocational assess^ment^were 
also represented « Since this approach to ''hands on" activities for vocational 
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assessment is in its infancy stage, the presenters merely reflected their own 
btief experiences related to their particular settings. Therefore, the 
following commentary is presented in an effort to discuss some implications 
tfl tisilhig the "systems" approach in career education programs* 

Geoeral Area of Assessment ^. 

Presently » there is little disagreement that some system of comprehensive 
assfsi^ment be established* It has been Indicated that evaluation should 
li^iude 'Wnds on" assessment In addition to the paper and pencil tests. 
tiUl iciformation provided in this workshop indicat«sd that there is no 
sp^^ific vocational assessment system marketed that can provide the total 
comprehensive evaluation desired* Each systen^ has Its strengths and weakneisiss 

\ 

a'fli therefore, must be considered dnly as one "^ool" that can be used by 
skilled p^'rsonnel to determine either vocational interests, aptitudes, and/or 
capabilities* 

Some doubt exists regarding the validity of the norms of all assessment 
systems as they relate to competitive work atmospheres* There is acceptance 
in recognizing that the "systems" approach is only an indicator and a useful / 
"tool" when in the hands of competent personnel* 

There is a general acceptance that the success of developing an accurate 
profile depends upon the ability of the evalua^or to perform adequately In 

directing, observing, and counseling a participant while being evaluated* 

/ 

It Is, also recognized that the evaluator cotild make various contributions 
to other personrlel in different disciplines in addition to providing a 
profile* These contributions could be in the areas of interpreting the 
profile and making suggestions for program adaptation* 

ll7 



, ■-.I 
tftere appears to be some confusion In understanding vocational evaluation, 

partieularly as educators become Involved. One ajrta of confusion results 
frwn a lack of common usage of teres which descrlSe the various components 
of ^^^«ional evaluation. Host educators are ^Mble to decij^r the 
rer«ia@logy with the knowledge they have gainedXthrough teacher training 
pr^raws. Some example^ of terns used synoiKMKxAly are: vocational evaluation,. 
I^iticii^l assessment, jwork evaluation, and J^analysis; ^rk sapples and 

i i ^^^^ evaluator and vt^atloftal cva^uator. This tereinolt^y or 
j*^^^ s*ems to be more consistent with Aose in i^habilitation than' in any 
oOriet discipline. Today, with tite tens "Career Edecation" imlying a br^der 
Bluing than "Vocational Educatio there i$ a need to clearly interpret 
cenaiftoldgy In order to pr<mote a better understanding of the vocational 
evaluation process as it relates to vocational preparation and job 
1 plaiesteiiiEe 

111® evaluation of performance skilU has largely b^n left up to 
rehabilitation personuele However, the evaluation of perforiwnce skills should 
not be reserved for the rehabilitation discipline* More often than not, 
interpretation of the results of an eva^ ation does not promote integrated 
dtsclpline involvement such as teacher traif^lng personnel and a ''team*' approach 
concept^ although the implications are ther0. It appears that the evaluators 
could provide more valuable information to other professionals working with 
the same population so that interpretation would not be foreign to those in 
education. 

Persons Served 

It Is quite evident that the conw^rclal systems are being used with 
different populations. It roust be pointed out that the "systems" couU 
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Jii^f'ai^ferent Implications when ased with the/<a) nondlsabled youth and 
ad^lti In educational prograas. <b) disadvantaged and handicapped youth 
MM iAilts in special programs and (c) population served on an individual 
hMl«$a.«.. rehahllltation clients, corrections population, welfare' 
^«ipl*nt8, etc. The apprwich used for wich Individual eay vary with respect 
t^"^ ohjectlve which needs to be acconpllshed. For soM. the experience 

vocational aiMreness. or exploiratlon and for others evaluation of 
p^ltic v(^atio!nal skills aiay be necessary. 

} ,!•; !^re has been little discussion as to the necessary preparation that 
;^p,^ps of Individuals my need prior to going throng an asansMnt 

It has been suggested that, there -ay be i«il«e li5 .epeetlNl assMMM«t 

WtfVttles more than once or twice with som Individuals. Thle, agalni 

ItpMis upon th€ objective to be achieved. 

there l»8 been little discussion or evidence presented that assaasan^ 

I '' 

sysM can benefit populations without physical, mental, or cultural 

ilffiitatlons. 

there appears to be some differences of opinion regarding the nu«ber of 
'^rsons that could be served at one time by coomerclal systems. The nuebers 
range from five to twelve any one time depending upon the system used 
and Che Individuals partlclpatt^.ng. 

Idoeational Program Change 

It appeaVs that evaluation does Indicate Individual Interests, aptitudes 
and capabilities which can provide educators with criteria for adaptation of 
curriculum to satisfy individual needs. The Individual profile and related 
information ha^s Implicationf. for related Instruction, specialised counselH^. 
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vocational exploration and skill training, and identification of special 
individual needs. This type of information caa assist the school in promoting 
individualized attention within a general program concept that may range in 
degree from serving the nonacademic student to the more academically inclined. 
^This implies the use of teacher aides, team teaching, resource rooms, edv.ca tionai 
specialists, and paraprofessionals from the community. 

Individual profiles and dialogue from evaluators should assist educators 
in reviewing existing curriculum in its relationship to satisfying 
individual needs. This review could lead to curriculum change. Aie^s of 
change could revolve around realistic competencies as they relate to career 
development and skill training. 

Utilizing the "systems" data for program change, could promote the 
identification of more tangible objectives so that educators can spell out 
who's going to be served, what and how it's to be done and how well and when. 

Understanding and using systems data indicates the need for other 
discipline (school and community) involvement in planning the total program 
concept. Utilization of the inforrnat: »n could contribute to the role and 
respqnsibility of school personnel from the areas of guidance, special 
and regular academic instruction and career education personnel. CommLinity 
representatives from areas of rehabili tatioi, employment, welfare, and 
industry definitely should have various degrees of involvement in f'p 
Inservice tor all personnel is necessary to encourage appropriate .d irec tions . 
It is necessary to orient all who are involved on what's being atte.-;ipt.ed , 
the role and responsibility of each and models for deciding program direction 
and ongoing review for necessary program change. 
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Proei-i.'.i Uuin',e :nav impLv tlexible iiednl ioi^ and niodn I ar^ ifroun-'iMii n^^. 
so that students are not "lucked in" by traditional curriculuai areas as 
promoted k^enerallv l)v traditional educational structure. This approach can 
provide students the opportunity to n^ove "in and out" of classroom] and 
laboratory areas as individual adjustment and progress indicates. 

Teacher Training 

Directions are quite evident for teacher training prograf^s as a result 
of the exposure to the "systems" units. Institutions offering teacher 
trainin^ programs should involve all departments who are training personnel 
in education and related areas in building additional concepts into courses 
that are related to career education. Training institutions can conduct 
inservice activities to identify present program activity and upgrade 
personnel responsible for each program. At the same time, criteria should 
be established for preservice programs in the preparation of new personnel. 
Teacher training staff should be provided opportunities to communicate, 
s.hare information, and plan and implement with their colleagues from varying 
disclp]l-es to^ nro-^ote comprehensive and total career education programming. 
These few su^^^estions reflect the feedback from the use of assessment 
sys terns 

r ol lot-'-iTr 



Schools have not demonstrated the ability to retrive meaningful 
data relating t^' the implications that assessment technique^: r-^ply* The 
exi'^tin^^ assessfncnt data aviilable tc educators is utilised very little 
ut pro^r . chan,<e e ;en thoui^h this data has meaning for that change. The 
assess -e't apprt^ac hes reviewed -U this wc^rkshop only reinforce the need to 
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iovk At ttio .issessment information and program results in order to purs^ue 
appropriate and n^eaningful directions. The evaluation component Includink; 
the t'oilow'-up Oil what happen!? to people is necessary for educatt)rs m 
determiniiu; whether existing programs are justified* Educators cannot 
continue to rely on jssujneu educational activities that are good tor all 
students. It is necessary for educators to b^tome more involved in the 

, — 

tollow-up proc^ess so that they become more realistic in determining whether 
objectives and goals are accomplished. Utilization of assessment syr.tems 
promt te this direction.^ 

Conclusion 

The purpose of this workshop was to: (1) identify career assessment 
systems available for purchase (2) review the characteristics of each, 
and (3) explore the potential utilization of the "systems" components 
in educational settings (schools). 

Even^though work evaluation has been pioneered by rehabilitation services 
it is quite evident that many of these evaluation components could be 
benefxciil to educators it helping young people make realistic vocational 
decisions. The justification and acceptance of the vocational evaluatK^p 
sTSte-Tis school qiust be guided by defined boundaries and tangible 
objectives witn a coT.mitnent for program change (adaptation),. 

Educators rTn.-^t n^ake a decision on whether appropriate vocational 
direction^ should be provided young people only by the use of the written 
'..ord ur by utilizing work experience and/or work exploration througn work 
samples in addition to the written word. The amendments to the Vocational 
i::ducation A; t as 'veil as other efforts in promoting work awareness and 
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vocational skill training promotes the necessary challenge. It is now up 
to all disciplines that can contribute to provide the comprehensive effort 
in helping young people more accurately identify their vocational potential. 
Educators should be able to utilize many of the evaluation components from 
the commercial systems on the market today, however, at the same time this 
effort must reflect realistic objectives in meeting individual needs as 
related to fulfilling manpower demands* 



Dan Kroloff 
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